00000001:02000400:1.0F:1789061660.722554:0:3297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_hostid 00000001:02000400:1.0:1789061669.779918:0:3499:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1789061670.681327:0:3542:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1355 MB/s 00000001:01000000:1.0:1789061670.931040:0:3542:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1647 MB/s 00000001:01000000:1.0:1789061671.180715:0:3542:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10539 MB/s 00000020:02000000:2.0F:1789061671.498833:0:3589:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_ga794951 00000400:02000000:2.0:1789061671.875043:0:3604:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.103@tcp [8/256/0/180] 00008000:02000000:2.0:1789061674.319816:0:3753:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789061738.767796:0:5722:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing load_modules_local 00000020:01000004:3.0F:1789061752.483056:0:6472:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789061752.483069:0:6472:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789061752.483071:0:6472:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789061752.483214:0:6472:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006c09a73c 00000080:02000400:3.0:1789061752.483225:0:6472:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789061752.490469:0:6472:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789061752.490482:0:6472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789061752.490510:0:6472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002ad451ed) 00000020:00000080:3.0:1789061752.490528:0:6472:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789061752.563410:0:6472:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789061752.563886:0:6472:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1789061752.600304:0:6472:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789061752.602937:0:6472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789061752.602948:0:6472:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789061752.602958:0:6472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc6257 00000020:01000004:3.0:1789061752.602965:0:6472:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789061752.602969:0:6472:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789061752.602973:0:6472:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006c09a73c from MGS 00000020:01000004:3.0:1789061752.602977:0:6472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789061752.602988:0:6472:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000007645345a) 00000020:00000080:3.0:1789061752.602999:0:6472:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789061752.603060:0:6472:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006c09a73c from MGS, refs=2 00080000:01000000:3.0:1789061752.603065:0:6472:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789061752.603068:0:6472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc6265 00000100:00100000:3.0:1789061752.603251:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789061752.603372:0:6472:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789061752.603379:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0F:1789061752.604034:0:6472:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789061752.604046:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789061752.605268:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789061752.605499:0:6472:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789061752.605505:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789061752.606276:0:6472:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789061752.606284:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789061752.613946:0:6472:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789061752.613965:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789061752.616714:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061752.616720:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061752.616722:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061752.621636:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061752.621643:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061752.621645:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061752.622192:0:6472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789061752.629599:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789061752.871770:0:6472:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3411 MB/s 00000001:01000000:2.0:1789061753.121698:0:6472:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3451 MB/s 00000001:01000000:3.0:1789061753.372451:0:6472:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 515 MB/s 00000001:01000000:2.0:1789061753.625585:0:6472:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 790 MB/s 00080000:10000000:2.0:1789061753.634137:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1789061753.646951:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789061753.655757:0:6472:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789061753.656399:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789061753.656440:0:6472:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789061753.656477:0:6472:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789061753.656648:0:6472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789061753.656671:0:6472:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789061753.657006:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061753.657168:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789061753.657174:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789061753.666660:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789061753.666674:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789061753.669984:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789061753.673427:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789061753.674393:0:6472:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789061753.674414:0:6472:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.103@tcp' 00000020:01000004:0.0:1789061753.674416:0:6472:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789061753.674462:0:6472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.103@tcp (typ=mgc) 00000020:00000080:0.0:1789061753.674481:0:6472:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.103@tcp (00000000a67c483c) 00000020:00000080:0.0:1789061753.674496:0:6472:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789061753.674590:0:6472:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e269c745@MGC192.168.203.103@tcp: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1789061753.674796:0:6472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.103@tcp-0 is initialized 00000040:01000000:0.0:1789061753.674802:0:6472:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789061753.676313:0:6492:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789061753.676411:0:6493:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789061753.676456:0:6472:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.103@tcp (uuid c4c9b030-cc89-4fa3-a2aa-771221619f7d) 00000020:00000080:2.0:1789061753.676478:0:6472:0:(genops.c:1384:class_connect()) connect: client c4c9b030-cc89-4fa3-a2aa-771221619f7d, cookie 0x2774d8f311dc6273 00000100:00080000:2.0:1789061753.676488:0:6472:0:(import.c:545:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789061753.676497:0:6472:0:(import.c:666:import_select_connection()) MGC192.168.203.103@tcp: import 00000000e269c745 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789061753.676536:0:6472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004b165fc2 x1875967130730624/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789061753.676559:0:6472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c4c9b030-cc89-4fa3-a2aa-771221619f7d->MGS 00000020:01000004:2.0:1789061753.676577:0:6472:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789061753.676582:0:6472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789061753.676601:0:6472:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c66d5ba5) 00000020:00000080:2.0:1789061753.676639:0:6472:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789061753.681088:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b165fc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3619:1875967130730624:0@lo:250: 00000100:00100000:3.0:1789061753.681204:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061753.685247:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130730624 00000100:00100000:1.0:1789061753.685261:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130730624 00000100:00100000:3.0:1789061753.691480:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789061753.691714:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789061753.691720:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789061753.693025:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789061753.693033:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789061753.693222:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789061753.693227:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789061753.693698:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789061753.693844:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789061753.693848:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789061753.694708:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061753.694717:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006eb75309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3619:x1875967130730624:12345-0@lo:250: 00010000:00080000:1.0:1789061753.694745:0:6488:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c4c9b030-cc89-4fa3-a2aa-771221619f7d@0@lo t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:1.0:1789061753.694781:0:6488:0:(genops.c:1384:class_connect()) connect: client c4c9b030-cc89-4fa3-a2aa-771221619f7d, cookie 0x2774d8f311dc6281 00000100:00080000:1.0:1789061753.694890:0:6488:0:(import.c:65:import_set_state_nolock()) 00000000e9196958 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061753.694941:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006eb75309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:3619:x1875967130730624:12345-0@lo:250: Request processed in 224us (13739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061753.694949:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061753.695069:0:3619:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789061753.695078:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.103@tcp: connect to target with instance 0 00000100:00080000:3.0:1789061753.695085:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789061753.695089:0:3619:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789061753.695092:0:3619:0:(import.c:65:import_set_state_nolock()) 00000000e269c745 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789061753.695094:0:3619:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789061753.695103:0:3619:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789061753.695107:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b165fc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3619:1875967130730624:0@lo:250: 00000100:00100000:1.0:1789061753.696531:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789061753.696540:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789061753.752869:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789061753.753161:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789061753.753169:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789061753.754270:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789061753.754280:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789061753.756103:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789061753.756319:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789061753.756324:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789061753.757095:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789061753.757103:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789061753.758224:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789061753.758526:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789061753.758531:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789061753.759940:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789061753.759949:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789061753.760538:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789061753.760803:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789061753.760816:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789061753.761304:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789061753.761310:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789061753.781725:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789061753.782030:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789061753.782038:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789061753.783420:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789061753.783430:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789061753.784251:0:6472:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789061753.784259:0:6472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789061753.784957:0:6472:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789061753.784981:0:6472:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789061753.784987:0:6472:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789061753.785072:0:6472:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789061753.785100:0:6472:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789061753.785107:0:6472:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789061753.785109:0:6472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789061753.785110:0:6472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061753.785111:0:6472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061753.785112:0:6472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061753.785113:0:6472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061753.785115:0:6472:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789061753.785116:0:6472:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789061753.785117:0:6472:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789061753.785118:0:6472:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789061753.785120:0:6472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061753.785121:0:6472:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789061753.785123:0:6472:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789061753.785125:0:6472:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789061753.785126:0:6472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789061753.785127:0:6472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061753.785128:0:6472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061753.785129:0:6472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061753.785130:0:6472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061753.785131:0:6472:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789061753.785132:0:6472:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789061753.785132:0:6472:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789061753.785133:0:6472:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789061753.785134:0:6472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061753.785135:0:6472:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789061753.785179:0:6472:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789061753.785194:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a143c1d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130730752:0@lo:253: 00000100:00100000:0.0:1789061753.785259:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061753.785307:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e55daa19 going to sleep for 11 seconds 00000100:00100000:3.0:1789061753.785632:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130730752 00000100:00100000:3.0:1789061753.785639:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130730752 00000100:00100000:3.0:1789061753.785679:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061753.785686:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000006bfec0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:6472:x1875967130730752:12345-0@lo:253: 20000000:01000000:3.0:1789061753.785729:0:6491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789061753.785734:0:6491:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789061753.786087:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789061753.786129:0:6491:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789061753.786402:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061753.788017:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789061753.788221:0:6491:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789061753.788225:0:6491:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789061753.788231:0:6491:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789061753.788234:0:6491:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789061753.788243:0:6491:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789061753.788559:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061753.788915:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789061753.789012:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789061753.789037:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789061753.789051:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789061753.789062:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789061753.789109:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789061753.789116:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789061753.789126:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789061753.789130:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789061753.789318:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789061753.789325:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789061753.789336:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789061753.789413:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789061753.789440:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789061753.789708:0:6491:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789061753.789719:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061753.789813:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789061753.789822:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789061753.789834:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789061753.789846:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789061753.789857:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789061753.789864:0:6491:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789061753.789883:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789061753.789889:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789061753.789899:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789061753.789910:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789061753.789988:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789061753.789998:0:6491:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789061753.790020:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789061753.790026:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789061753.790037:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789061753.790050:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789061753.790093:0:6491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789061753.790109:0:6491:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789061753.790121:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789061753.790729:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789061753.790889:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789061753.790909:0:6491:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.103@tcp for mdt 20000000:01000000:0.0:1789061753.790911:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:0.0:1789061753.791126:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789061753.791136:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789061753.791163:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789061753.791169:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:0.0:1789061753.791202:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789061753.791212:0:6491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789061753.791225:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789061753.791237:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789061753.791265:0:6491:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789061753.791268:0:6491:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789061753.791271:0:6491:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789061753.791323:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789061753.791325:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789061753.791995:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789061753.792100:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789061753.792124:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789061753.792137:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1789061753.792146:0:6491:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789061753.792148:0:6491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789061753.792494:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789061753.793841:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789061753.793871:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789061753.793908:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1789061753.793924:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789061753.793927:0:6491:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789061753.793932:0:6491:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789061753.793941:0:6491:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789061753.793947:0:6491:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789061753.793953:0:6491:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789061753.794331:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789061753.794602:0:6491:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789061753.812830:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789061753.812868:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789061753.812883:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789061753.812903:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789061753.812925:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003ac0e732/0x2774d8f311dc6288 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.812941:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ac0e732/0x2774d8f311dc6288 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.812950:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003ac0e732/0x2774d8f311dc6288 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.812955:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003ac0e732/0x2774d8f311dc6288 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.812960:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003ac0e732/0x2774d8f311dc6288 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.812967:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003ac0e732/0x2774d8f311dc6288 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.812973:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003ac0e732 already unused, calling callback (00000000c3156870) 00010000:00010000:2.0:1789061753.812976:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003ac0e732/0x2774d8f311dc6288 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.812998:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003ac0e732/0x2774d8f311dc6288 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.813013:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003ac0e732/0x2774d8f311dc6288 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.813019:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003ac0e732/0x2774d8f311dc6288 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.813023:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003ac0e732/0x2774d8f311dc6288 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789061753.813118:0:6491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789061753.821218:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000006bfec0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:6472:x1875967130730752:12345-0@lo:253: Request processed in 35524us (35951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061753.821238:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061753.821324:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a143c1d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130730752:0@lo:253: 10000000:01000000:3.0:1789061753.821355:0:6472:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789061753.821358:0:6472:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789061753.821361:0:6472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789061753.821362:0:6472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789061753.821363:0:6472:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789061753.821364:0:6472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789061753.821365:0:6472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789061753.821366:0:6472:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789061753.821368:0:6472:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789061753.821369:0:6472:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789061753.821370:0:6472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789061753.821371:0:6472:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789061753.821389:0:6472:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006c09a73c from lustre-MDT0000 10000000:01000000:3.0:1789061753.821417:0:6472:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789061753.821419:0:6472:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789061753.821423:0:6472:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9767f38a8000 10000000:01000000:3.0:1789061753.821426:0:6472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789061753.821434:0:6472:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9767f38a8000 from 1 10000000:01000000:3.0:1789061753.821436:0:6472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789061753.821494:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.821504:0:6472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.821519:0:6472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.821534:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d8fd363 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130730880:0@lo:101: 00000100:00100000:3.0:1789061753.821568:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.821657:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e6df110 going to sleep for 11 seconds 00000100:00100000:0.0:1789061753.821729:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130730880 00000100:00100000:0.0:1789061753.821736:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130730880 00000100:00100000:0.0:1789061753.821767:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789061753.821773:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000103dbff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:6472:x1875967130730880:12345-0@lo:101: 00010000:00010000:0.0:1789061753.821784:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061753.821798:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012c88de1/0x2774d8f311dc6296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc628f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.821828:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012c88de1/0x2774d8f311dc6296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc628f expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.821836:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012c88de1/0x2774d8f311dc6296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc628f expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.821843:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012c88de1, rc 0) 00000100:00100000:0.0:1789061753.821880:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000103dbff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:6472:x1875967130730880:12345-0@lo:101: Request processed in 108us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061753.821885:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061753.822818:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d8fd363 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130730880:0@lo:101: 00010000:00010000:3.0:1789061753.822840:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6296 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.822850:0:6472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6296 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.822937:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d8fd363 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130731008:0@lo:501: 00000100:00100000:3.0:1789061753.822980:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.823509:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e6df110 going to sleep for 11 seconds 00000100:00100000:0.0:1789061753.829069:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130731008 00000100:00100000:0.0:1789061753.829085:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130731008 00000100:00100000:1.0:1789061753.829207:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789061753.829216:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb2f9c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:6472:x1875967130731008:12345-0@lo:501: 00000100:00100000:3.0:1789061753.829391:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d8fd363 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130731008:0@lo:501: 10000000:01000000:3.0:1789061753.829442:0:6472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00000100:00100000:1.0:1789061753.829461:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb2f9c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:6472:x1875967130731008:12345-0@lo:501: Request processed in 129us (6363us total) trans 0 rc -2/-2 00010000:00010000:3.0:1789061753.829465:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6296 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061753.829470:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789061753.829476:0:6472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6296 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061753.829489:0:6472:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9767c3163000 10000000:01000000:3.0:1789061753.829493:0:6472:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789061753.829509:0:6472:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9767c3163000 10000000:01000000:3.0:1789061753.829518:0:6472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789061753.829521:0:6472:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9767c3163000 from 1 10000000:01000000:3.0:1789061753.829523:0:6472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789061753.829560:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000769b2bca/0x2774d8f311dc629d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.829567:0:6472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000769b2bca/0x2774d8f311dc629d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.829575:0:6472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000769b2bca/0x2774d8f311dc629d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.829591:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d8fd363 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130731136:0@lo:101: 00000100:00100000:3.0:1789061753.829810:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.829848:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e6df110 going to sleep for 11 seconds 00000100:00100000:2.0:1789061753.830065:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130731136 00000100:00100000:2.0:1789061753.830070:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130731136 00000100:00100000:2.0:1789061753.830106:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789061753.830113:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000018fcd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:6472:x1875967130731136:12345-0@lo:101: 00010000:00010000:2.0:1789061753.830122:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061753.830133:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003ac0e732/0x2774d8f311dc62a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc629d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.830165:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ac0e732/0x2774d8f311dc62a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc629d expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.830174:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003ac0e732/0x2774d8f311dc62a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc629d expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.830181:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003ac0e732, rc 0) 00000100:00100000:2.0:1789061753.830231:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000018fcd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+7:6472:x1875967130731136:12345-0@lo:101: Request processed in 118us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061753.830240:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789061753.830689:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d8fd363 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130731136:0@lo:101: 00010000:00010000:3.0:1789061753.830705:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000769b2bca/0x2774d8f311dc629d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.830713:0:6472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000769b2bca/0x2774d8f311dc629d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061753.830726:0:6472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789061753.830744:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000769b2bca/0x2774d8f311dc629d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.830750:0:6472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000769b2bca/0x2774d8f311dc629d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061753.830769:0:6472:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789061753.830773:0:6472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789061753.830779:0:6472:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9767c3163000 10000000:01000000:3.0:1789061753.830781:0:6472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789061753.830784:0:6472:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789061753.830786:0:6472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789061753.830803:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.830810:0:6472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.830816:0:6472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.830828:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d8fd363 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130731264:0@lo:101: 00000100:00100000:3.0:1789061753.830858:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.830888:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e6df110 going to sleep for 11 seconds 00000100:00100000:1.0:1789061753.830948:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130731264 00000100:00100000:1.0:1789061753.830953:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130731264 00000100:00100000:1.0:1789061753.830990:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789061753.830997:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae2c0bf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+7:6472:x1875967130731264:12345-0@lo:101: 00010000:00010000:1.0:1789061753.831005:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061753.831014:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005abb0a99/0x2774d8f311dc62b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc62ab expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.831027:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005abb0a99/0x2774d8f311dc62b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc62ab expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.831033:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005abb0a99/0x2774d8f311dc62b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc62ab expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.831039:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005abb0a99, rc 0) 00000100:00100000:1.0:1789061753.831079:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae2c0bf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+8:6472:x1875967130731264:12345-0@lo:101: Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061753.831085:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789061753.831579:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d8fd363 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130731264:0@lo:101: 00010000:00010000:0.0:1789061753.831593:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc62b2 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.831600:0:6472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc62b2 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061753.831672:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000048c85d07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130731392:0@lo:501: 00000100:00100000:0.0:1789061753.831704:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061753.831734:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3bdaaae going to sleep for 11 seconds 00000100:00100000:3.0:1789061753.831841:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130731392 00000100:00100000:3.0:1789061753.831846:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130731392 00000100:00100000:3.0:1789061753.831881:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789061753.831890:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001236a1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+8:6472:x1875967130731392:12345-0@lo:501: 00000100:00100000:3.0:1789061753.832000:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001236a1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+9:6472:x1875967130731392:12345-0@lo:501: Request processed in 113us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061753.832007:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789061753.832085:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000048c85d07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130731392:0@lo:501: 00000100:00100000:0.0:1789061753.832118:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000048c85d07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130731520:0@lo:503: 00000100:00100000:0.0:1789061753.832167:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061753.832189:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3bdaaae going to sleep for 11 seconds 00000100:00100000:3.0:1789061753.832244:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130731520 00000100:00100000:3.0:1789061753.832249:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130731520 00000100:00100000:3.0:1789061753.832277:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789061753.832289:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfd395 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+9:6472:x1875967130731520:12345-0@lo:503: 00000100:00100000:3.0:1789061753.832380:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfd395 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+9:6472:x1875967130731520:12345-0@lo:503: Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061753.832386:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789061753.832469:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000048c85d07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130731520:0@lo:503: 00000100:00100000:2.0:1789061753.834116:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016738007 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6518:1875967130731648:0@lo:502: 00000100:00100000:2.0:1789061753.834186:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061753.834224:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4e510a8 going to sleep for 11 seconds 00000100:00100000:0.0:1789061753.834279:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130731648 00000100:00100000:0.0:1789061753.834286:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130731648 00000100:00100000:0.0:1789061753.834326:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789061753.834342:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000846cb36e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+9:6518:x1875967130731648:12345-0@lo:502: 00000100:00100000:0.0:1789061753.834446:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000846cb36e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+9:6518:x1875967130731648:12345-0@lo:502: Request processed in 114us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061753.834454:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789061753.834687:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016738007 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6518:1875967130731648:0@lo:502: 00000020:01000000:2.0:1789061753.834715:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061753.834724:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061753.834727:0:6518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789061753.834731:0:6518:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789061753.834734:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789061753.834747:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000cddc0821) 00000020:00000080:2.0:1789061753.834761:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789061753.834765:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789061753.834840:0:6518:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789061753.834847:0:6518:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc62c0 00000020:00000080:2.0:1789061753.835059:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789061753.835063:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061753.835067:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061753.835068:0:6518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789061753.835070:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061753.835072:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061753.835073:0:6518:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789061753.835075:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789061753.835080:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000188ac0da) 00000020:00000080:2.0:1789061753.835087:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789061753.835090:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789061753.835091:0:6518:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789061753.835093:0:6518:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789061753.835102:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789061753.835132:0:6518:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006c09a73c from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789061753.835143:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000004afa502) 00000020:00000080:2.0:1789061753.835162:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789061753.835220:0:6518:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789061753.835225:0:6518:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc62d5 00000020:00000080:2.0:1789061753.835470:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789061753.835478:0:6518:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789061753.835482:0:6518:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2774d8f311dc62dc 00080000:01000000:2.0:1789061753.835488:0:6518:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789061753.835491:0:6518:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc62e3 00080000:10000000:3.0:1789061753.836073:0:6518:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789061753.836252:0:6518:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789061753.845047:0:6518:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789061753.927025:0:6518:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789061753.927336:0:6518:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789061753.931073:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789061753.931414:0:6518:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789061753.936918:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d854abd4) 00000020:00000080:1.0:1789061753.936940:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789061753.937049:0:6518:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789061753.937057:0:6518:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc62f1 00000020:00000080:0.0:1789061753.937763:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789061753.938549:0:6518:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1789061753.940502:0:6518:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1789061753.946362:0:6518:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1789061753.949102:0:6518:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1789061753.951306:0:6518:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1789061753.954786:0:6518:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1789061753.960790:0:6518:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2774d8f311dc62f8 00000020:00000080:1.0:1789061753.962300:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789061753.962315:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061753.962322:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061753.962324:0:6518:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789061753.962327:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061753.962330:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061753.962332:0:6518:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789061753.962334:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789061753.962336:0:6518:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789061753.962338:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061753.962341:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061753.962342:0:6518:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789061753.962351:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061753.962355:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061753.962356:0:6518:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789061753.962360:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789061753.962420:0:6518:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789061753.962485:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000658e9c4c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6518:1875967130731776:0@lo:502: 00000100:00100000:1.0:1789061753.962575:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061753.962651:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fcca571 going to sleep for 11 seconds 00000100:00100000:2.0:1789061753.962720:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130731776 00000100:00100000:2.0:1789061753.962727:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130731776 00000100:00100000:2.0:1789061753.962778:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789061753.962786:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000773ac320 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+9:6518:x1875967130731776:12345-0@lo:502: 00000100:00100000:2.0:1789061753.962899:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000773ac320 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+9:6518:x1875967130731776:12345-0@lo:502: Request processed in 114us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061753.962907:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789061753.963384:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000658e9c4c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6518:1875967130731776:0@lo:502: 00000020:01000000:1.0:1789061753.963412:0:6518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061753.963418:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061753.963420:0:6518:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789061753.963424:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789061753.963811:0:6472:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789061753.963834:0:6472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789061753.963851:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc62b2 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.963861:0:6472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc62b2 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061753.964103:0:6472:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767c3163000 from 1 10000000:01000000:3.0:1789061753.964107:0:6472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789061753.964137:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.964145:0:6472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.964166:0:6472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.964182:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130731904:0@lo:101: 00000100:00100000:3.0:1789061753.964248:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.964285:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e6df110 going to sleep for 11 seconds 00000100:00100000:1.0:1789061753.964291:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130731904 00000100:00100000:1.0:1789061753.964298:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130731904 00000100:00100000:1.0:1789061753.964334:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789061753.964341:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb802088 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+9:6472:x1875967130731904:12345-0@lo:101: 00010000:00010000:1.0:1789061753.964361:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061753.964374:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c0cde8a/0x2774d8f311dc6306 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc62ff expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.964398:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c0cde8a/0x2774d8f311dc6306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc62ff expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.964407:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c0cde8a/0x2774d8f311dc6306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc62ff expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061753.964414:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c0cde8a, rc 0) 00000100:00100000:1.0:1789061753.964457:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb802088 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+10:6472:x1875967130731904:12345-0@lo:101: Request processed in 117us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061753.964464:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789061753.964583:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130731904:0@lo:101: 00010000:00010000:3.0:1789061753.964596:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6306 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.964603:0:6472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6306 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.965408:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732032:0@lo:256: 00000100:00100000:3.0:1789061753.965456:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.965521:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e6df110 going to sleep for 11 seconds 00000100:00100000:1.0:1789061753.965559:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130732032 00000100:00100000:1.0:1789061753.965564:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130732032 00000100:00100000:1.0:1789061753.966235:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789061753.966249:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000015d5b455 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+10:6472:x1875967130732032:12345-0@lo:256: 20000000:01000000:1.0:1789061753.966268:0:6488:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789061753.966274:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789061753.966514:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000015d5b455 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+10:6472:x1875967130732032:12345-0@lo:256: Request processed in 270us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061753.966547:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732032:0@lo:256: 10000000:01000000:3.0:1789061753.967125:0:6472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789061753.967164:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6306 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.967174:0:6472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6306 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061753.967182:0:6472:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767c3163000 from 1 10000000:01000000:3.0:1789061753.967184:0:6472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789061753.967219:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.967226:0:6472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.967234:0:6472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.967250:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732160:0@lo:101: 00000100:00100000:3.0:1789061753.967288:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.967318:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e6df110 going to sleep for 11 seconds 00000100:00100000:0.0:1789061753.967941:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130732160 00000100:00100000:0.0:1789061753.967951:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130732160 00000100:00100000:1.0:1789061753.968022:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789061753.969068:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789061753.969082:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f5b60d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+10:6472:x1875967130732160:12345-0@lo:101: 00010000:00010000:0.0:1789061753.969098:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061753.969115:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a707b56a/0x2774d8f311dc6314 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc630d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.969139:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a707b56a/0x2774d8f311dc6314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc630d expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.969157:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a707b56a/0x2774d8f311dc6314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc630d expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.969165:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a707b56a, rc 0) 00000100:00100000:0.0:1789061753.969225:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f5b60d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+11:6472:x1875967130732160:12345-0@lo:101: Request processed in 149us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061753.969231:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789061753.969260:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732160:0@lo:101: 00010000:00010000:3.0:1789061753.969277:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6314 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.969286:0:6472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6314 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.969377:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732288:0@lo:501: 00000100:00100000:3.0:1789061753.969409:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.969473:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e6df110 going to sleep for 11 seconds 00000100:00100000:1.0:1789061753.969826:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130732288 00000100:00100000:1.0:1789061753.969834:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130732288 00000100:00100000:1.0:1789061753.969897:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789061753.969904:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008cba95e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+11:6472:x1875967130732288:12345-0@lo:501: 00000100:00100000:1.0:1789061753.970073:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008cba95e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+11:6472:x1875967130732288:12345-0@lo:501: Request processed in 170us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061753.970080:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789061753.970144:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732288:0@lo:501: 00000100:00100000:3.0:1789061753.970184:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732416:0@lo:503: 00000100:00100000:3.0:1789061753.970228:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.970259:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e6df110 going to sleep for 11 seconds 00000100:00100000:0.0:1789061753.971247:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130732416 00000100:00100000:0.0:1789061753.971256:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130732416 00000100:00100000:0.0:1789061753.971349:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789061753.971356:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000af411bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+11:6472:x1875967130732416:12345-0@lo:503: 00000040:00080000:0.0:1789061753.971400:0:6491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789061753.971478:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000af411bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+11:6472:x1875967130732416:12345-0@lo:503: Request processed in 123us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061753.971490:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789061753.971575:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732416:0@lo:503: 00000040:00080000:1.0:1789061753.973765:0:6522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789061753.974047:0:6472:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789061753.974070:0:6472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789061753.974090:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6314 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.974103:0:6472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6314 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061753.974158:0:6472:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789061753.974162:0:6472:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9767c3163000 10000000:01000000:3.0:1789061753.974165:0:6472:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9767c3163000 10000000:01000000:3.0:1789061753.974169:0:6472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789061753.974173:0:6472:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767c3163000 from 1 10000000:01000000:3.0:1789061753.974176:0:6472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789061753.974208:0:6472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.974216:0:6472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.974238:0:6472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.974258:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732544:0@lo:101: 00000100:00100000:3.0:1789061753.974312:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.975536:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b789ffbc going to sleep for 11 seconds 00000100:00100000:2.0:1789061753.975659:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130732544 00000100:00100000:2.0:1789061753.975667:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130732544 00000100:00100000:2.0:1789061753.975708:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789061753.975729:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d094ee54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+11:6472:x1875967130732544:12345-0@lo:101: 00010000:00010000:2.0:1789061753.975743:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061753.975757:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc631b expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.975788:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc631b expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.975798:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc631b expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061753.975806:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c6260e6, rc 0) 00000100:00100000:2.0:1789061753.975852:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d094ee54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6472:x1875967130732544:12345-0@lo:101: Request processed in 125us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061753.975859:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789061753.975966:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732544:0@lo:101: 00010000:00010000:3.0:1789061753.975982:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6322 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061753.975989:0:6472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6322 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061753.976055:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732672:0@lo:501: 00000100:00100000:3.0:1789061753.976083:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.976111:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b789ffbc going to sleep for 11 seconds 00000100:00100000:2.0:1789061753.976254:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130732672 00000100:00100000:2.0:1789061753.976259:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130732672 00000100:00100000:2.0:1789061753.976276:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789061753.976281:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002f0719c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6472:x1875967130732672:12345-0@lo:501: 00000100:00100000:2.0:1789061753.976393:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002f0719c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6472:x1875967130732672:12345-0@lo:501: Request processed in 112us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061753.976400:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789061753.976523:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732672:0@lo:501: 00000100:00100000:3.0:1789061753.976693:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732800:0@lo:503: 00000100:00100000:3.0:1789061753.976734:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.976795:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b789ffbc going to sleep for 11 seconds 00000100:00100000:0.0:1789061753.976943:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130732800 00000100:00100000:0.0:1789061753.976948:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130732800 00000100:00100000:2.0:1789061753.976988:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789061753.977052:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e18ed621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6472:x1875967130732800:12345-0@lo:503: 00000100:00100000:3.0:1789061753.977159:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e18ed621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6472:x1875967130732800:12345-0@lo:503: Request processed in 165us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061753.977166:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789061753.977288:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000806a545f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130732800:0@lo:503: 00000100:00100000:2.0:1789061753.977743:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016738007 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6523:1875967130732928:0@lo:502: 00000100:00100000:2.0:1789061753.977787:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061753.977815:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eaf6e4f2 going to sleep for 11 seconds 00000100:00100000:3.0:1789061753.977867:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130732928 00000100:00100000:3.0:1789061753.977878:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130732928 00000100:00100000:3.0:1789061753.977901:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789061753.977912:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003eb3ee9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6523:x1875967130732928:12345-0@lo:502: 00000100:00100000:3.0:1789061753.977995:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003eb3ee9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6523:x1875967130732928:12345-0@lo:502: Request processed in 83us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061753.978001:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789061753.978074:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016738007 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6523:1875967130732928:0@lo:502: 00000020:01000004:2.0:1789061753.978133:0:6523:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789061753.978167:0:6523:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009482f901) 00000020:00000080:2.0:1789061753.978186:0:6523:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789061753.978265:0:6523:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006c09a73c from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789061753.978269:0:6523:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006c09a73c from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789061753.978271:0:6523:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006c09a73c 4 00010000:00080000:2.0:1789061753.978295:0:6523:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000079448d13@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1789061753.984227:0:6523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789061753.984442:0:6523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789061753.984495:0:6523:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789061753.984508:0:6523:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2774d8f311dc6330 00000100:00080000:3.0:1789061753.984517:0:6523:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789061753.987837:0:6523:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000079448d13 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1789061753.987885:0:6523:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c42358e8 x1875967130733056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789061753.987919:0:6523:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789061753.988518:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c42358e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875967130733056:0@lo:38: 00000100:00100000:1.0:1789061753.988640:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061753.988807:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130733056 00000100:00100000:2.0:1789061753.988815:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130733056 00000100:00100000:2.0:1789061753.988856:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789061753.988863:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000658e9c4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875967130733056:12345-0@lo:38: 00000100:00100000:2.0:1789061753.988921:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000658e9c4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875967130733056:12345-0@lo:38: Request processed in 57us (316us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789061753.988929:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789061753.988969:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789061753.988976:0:3619:0:(import.c:65:import_set_state_nolock()) 0000000079448d13 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789061753.988979:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789061753.988982:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c42358e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875967130733056:0@lo:38: 00000100:00100000:3.0:1789061753.991986:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099efe1ec pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6523:1875967130733184:0@lo:502: 00000100:00100000:3.0:1789061753.992063:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061753.992108:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf723bad going to sleep for 11 seconds 00000100:00100000:0.0:1789061753.992725:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130733184 00000100:00100000:0.0:1789061753.992734:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130733184 00000100:00100000:0.0:1789061753.992777:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789061753.992784:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fb9b9cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6523:x1875967130733184:12345-0@lo:502: 00000100:00100000:0.0:1789061753.992905:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fb9b9cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6523:x1875967130733184:12345-0@lo:502: Request processed in 121us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061753.992914:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789061753.995873:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099efe1ec pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6523:1875967130733184:0@lo:502: 00000040:00080000:3.0:1789061753.995919:0:6523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789061753.996277:0:6472:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789061753.996303:0:6472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789061753.996321:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6322 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061753.996331:0:6472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6322 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789061753.996379:0:6472:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789061753.996382:0:6472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789061753.996383:0:6472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061753.996385:0:6472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061753.996386:0:6472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061753.996387:0:6472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061753.996388:0:6472:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789061753.996390:0:6472:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789061753.996395:0:6472:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789061753.996397:0:6472:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789061753.996398:0:6472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061753.996400:0:6472:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789061753.996403:0:6472:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789061753.996406:0:6472:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789061753.996407:0:6472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789061753.996408:0:6472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061753.996409:0:6472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061753.996410:0:6472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061753.996411:0:6472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061753.996412:0:6472:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789061753.996412:0:6472:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789061753.996413:0:6472:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789061753.996414:0:6472:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789061753.996415:0:6472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061753.996416:0:6472:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789061753.996437:0:6472:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789061753.996452:0:6472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb35529b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130733312:0@lo:253: 00000100:00100000:0.0:1789061753.996514:0:6472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061753.996652:0:6472:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c5efdc40 going to sleep for 11 seconds 00000100:00100000:3.0:1789061753.996718:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130733312 00000100:00100000:3.0:1789061753.996725:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130733312 00000100:00100000:3.0:1789061753.996770:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789061753.996777:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000029ae72c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6472:x1875967130733312:12345-0@lo:253: 20000000:01000000:3.0:1789061753.996800:0:6490:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789061753.996812:0:6490:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789061754.008003:0:6490:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789061754.008042:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789061754.008085:0:6512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789061754.008091:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789061754.008113:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.008131:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006c0cde8a/0x2774d8f311dc6306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc62ff expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.008139:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.008202:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006c0cde8a/0x2774d8f311dc6306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc62ff expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061754.008217:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006c0cde8a/0x2774d8f311dc6306 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc62ff expref: 12 pid: 6491 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061754.008230:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016738007 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130733440:0@lo:104: 00000100:00100000:2.0:1789061754.008290:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061754.008340:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036c2d63b going to sleep for 11 seconds 00000100:00100000:3.0:1789061754.008553:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000029ae72c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6472:x1875967130733312:12345-0@lo:253: Request processed in 11775us (12039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061754.008563:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789061754.008725:0:6472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb35529b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6472:1875967130733312:0@lo:253: 10000000:01000000:2.0:1789061754.008737:0:6472:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789061754.008740:0:6472:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789061754.008742:0:6472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789061754.008744:0:6472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061754.008745:0:6472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061754.008746:0:6472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061754.008747:0:6472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061754.008748:0:6472:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789061754.008750:0:6472:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789061754.008751:0:6472:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789061754.008752:0:6472:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789061754.008754:0:6472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061754.008755:0:6472:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789061754.008767:0:6472:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789061754.010017:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130733440 00000100:00100000:0.0:1789061754.010029:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130733440 00000100:00100000:0.0:1789061754.010083:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789061754.010091:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000c732bb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:6512:x1875967130733440:12345-0@lo:104: 00010000:00010000:0.0:1789061754.010106:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6306 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.010198:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789061754.010203:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000c732bb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:6512:x1875967130733440:12345-0@lo:104: Request processed in 114us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061754.010210:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789061754.010230:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061754.010235:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6306 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.010255:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003d4a09bb already unused, calling callback (000000006ac241b9) 10000000:00010000:0.0:1789061754.010258:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6306 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.010265:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6306 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061754.010272:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6306 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061754.010276:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789061754.010309:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6306 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.010317:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061754.010331:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6306 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.010337:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 000000003d4a09bb/0x2774d8f311dc62ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6306 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.010353:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061754.010355:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061754.010357:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061754.010495:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000232b40ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130733568:0@lo:103: 00000100:00100000:3.0:1789061754.010534:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061754.011703:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130733568 00000100:00100000:0.0:1789061754.011711:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130733568 00010000:00010000:0.0:1789061754.011737:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006c0cde8a/0x2774d8f311dc6306 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc62ff expref: 12 pid: 6491 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061754.011773:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789061754.011794:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000099efe1ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:3621:x1875967130733568:12345-0@lo:103: 00010000:00010000:0.0:1789061754.011819:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061754.011824:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006c0cde8a/0x2774d8f311dc6306 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc62ff expref: 12 pid: 6491 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.011834:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006c0cde8a/0x2774d8f311dc6306 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc62ff expref: 12 pid: 6491 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.011853:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.011861:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789061754.011878:0:6480:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003787779s 00010000:00010000:0.0:1789061754.011881:0:6480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.011888:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.011894:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.011899:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.011904:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009d352480 already unused, calling callback (00000000c3156870) 00010000:00010000:0.0:1789061754.011907:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.011913:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.011927:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061754.011937:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061754.011990:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000099efe1ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:3621:x1875967130733568:12345-0@lo:103: Request processed in 200us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061754.011997:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061754.012081:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000232b40ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130733568:0@lo:103: 00010000:00010000:3.0:1789061754.015698:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006c0cde8a/0x2774d8f311dc6306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc62ff expref: 11 pid: 6491 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061754.015727:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016738007 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130733440:0@lo:104: 00010000:00010000:3.0:1789061754.015750:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.015760:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.015765:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061754.015771:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009d352480/0x2774d8f311dc6337 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789061754.020602:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1789061754.023984:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789061754.026078:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1789061754.027244:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789061754.027477:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1789061754.027709:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789061754.034182:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1789061754.034359:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789061754.034565:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1789061754.034743:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789061754.034928:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1789061754.035081:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1789061754.042040:0:6472:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789061754.056312:0:6472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789061754.056445:0:6528:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789061754.056449:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789061754.057963:0:6529:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789061754.061367:0:6472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789061754.061476:0:6472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789061754.061973:0:6472:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789061754.061979:0:6472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789061754.062070:0:6472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061754.062990:0:6472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789061754.066241:0:6472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789061754.066403:0:6472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789061754.066662:0:6472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789061754.066911:0:6472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:2.0:1789061754.066931:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1789061754.075633:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789061754.075872:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789061754.076025:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789061754.076195:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789061754.076345:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789061754.076487:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789061754.076738:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000040:00080000:2.0:1789061754.076743:0:6529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789061754.076820:0:6529:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789061754.076825:0:6529:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1789061754.076896:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789061754.077034:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789061754.078873:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789061754.079407:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789061754.079703:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789061754.079854:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789061754.079994:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789061754.083122:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789061754.085715:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789061754.086246:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789061754.086549:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789061754.086733:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789061754.086929:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789061754.087203:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789061754.087372:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789061754.087506:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789061754.087669:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789061754.087800:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789061754.088065:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789061754.088245:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789061754.088421:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789061754.088555:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789061754.089023:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789061754.089175:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789061754.089323:0:6472:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789061754.094769:0:6472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1789061754.110738:0:6472:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789061754.110783:0:6472:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc8841743988 00100000:10000000:3.0:1789061754.110790:0:6472:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789061754.113048:0:6472:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789061754.113066:0:6472:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789061754.113084:0:6472:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1789061754.113111:0:6472:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789061754.116376:0:6472:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789061754.116935:0:6472:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789061754.670823:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061755.690875:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061756.715514:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061757.743195:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789061758.540277:0:6773:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789061758.762355:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789061759.145818:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789061759.145827:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767c3163000 from 3 10000000:01000000:0.0:1789061759.145832:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789061759.145872:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061759.145884:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061759.145894:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061759.145915:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bbaf5c35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130733696:0@lo:101: 00000100:00100000:0.0:1789061759.146023:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061759.146062:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045d821b4 going to sleep for 11 seconds 00000100:00100000:0.0:1789061759.146081:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130733696 00000100:00100000:0.0:1789061759.146088:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130733696 00000100:00100000:0.0:1789061759.146140:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789061759.146148:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000338d0e62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+11:6493:x1875967130733696:12345-0@lo:101: 00010000:00010000:0.0:1789061759.146161:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061759.146172:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000573406aa/0x2774d8f311dc6345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc633e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061759.146192:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000573406aa/0x2774d8f311dc6345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc633e expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061759.146202:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000573406aa/0x2774d8f311dc6345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc633e expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061759.146209:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000573406aa, rc 0) 00000100:00100000:0.0:1789061759.146242:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000338d0e62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6493:x1875967130733696:12345-0@lo:101: Request processed in 95us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061759.146248:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789061759.146292:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bbaf5c35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130733696:0@lo:101: 00010000:00010000:0.0:1789061759.146305:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6345 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061759.146312:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6345 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061759.146355:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bbaf5c35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130733824:0@lo:256: 00000100:00100000:0.0:1789061759.146391:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061759.146405:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045d821b4 going to sleep for 11 seconds 00000100:00100000:0.0:1789061759.146417:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130733824 00000100:00100000:0.0:1789061759.146421:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130733824 00000100:00100000:0.0:1789061759.146441:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789061759.146602:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000059823311 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6493:x1875967130733824:12345-0@lo:256: 20000000:01000000:0.0:1789061759.146637:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789061759.146651:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789061759.146653:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789061759.146733:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000059823311 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:6493:x1875967130733824:12345-0@lo:256: Request processed in 133us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061759.146739:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789061759.146766:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bbaf5c35 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130733824:0@lo:256: 10000000:01000000:0.0:1789061759.146853:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789061759.146858:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6345 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061759.146866:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6345 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789061759.156672:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789061759.156679:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789061759.156682:0:8:0:(import.c:65:import_set_state_nolock()) 0000000079448d13 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789061759.156698:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000079448d13 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1789061759.156732:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bbaf5c35 x1875967130733952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789061759.157269:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bbaf5c35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875967130733952:0@lo:38: 00000100:00100000:3.0:1789061759.157333:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061759.157436:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130733952 00000100:00100000:0.0:1789061759.157560:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130733952 00000100:00100000:0.0:1789061759.157637:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789061759.157643:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e22a04f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875967130733952:12345-0@lo:38: 00010000:00080000:0.0:1789061759.157666:0:6498:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:0.0:1789061759.157696:0:6498:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2774d8f311dc634c 00000004:00100000:0.0:1789061759.157979:0:6498:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789061759.158091:0:6498:0:(import.c:65:import_set_state_nolock()) 00000000ad006101 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789061759.158213:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e22a04f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875967130733952:12345-0@lo:38: Request processed in 568us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061759.158220:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789061759.158275:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bbaf5c35 x1875967130733952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789061769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789061759.158290:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789061759.158311:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789061759.158316:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789061759.158319:0:3619:0:(import.c:65:import_set_state_nolock()) 0000000079448d13 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789061759.158324:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bbaf5c35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875967130733952:0@lo:38: 00000020:00000004:3.0:1789061759.362417:0:6825:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789061759.362595:0:6825:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789061759.786329:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061760.813243:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061761.834147:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789061762.106066:0:6927:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789061762.106303:0:6927:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789061762.859035:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061763.883664:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061764.269020:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002170d085 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130734208:0@lo:400: 00000100:00100000:3.0:1789061764.269104:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061764.269146:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061764.269152:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f139b6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130734080:0@lo:400: 00000100:00100000:3.0:1789061764.269180:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061764.269210:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130734080 00000100:00100000:3.0:1789061764.269216:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130734080 00000100:00100000:3.0:1789061764.269254:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789061764.269261:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f5a75928 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:3623:x1875967130734080:12345-0@lo:400: 00000100:00100000:3.0:1789061764.269303:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f5a75928 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:3623:x1875967130734080:12345-0@lo:400: Request processed in 44us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061764.269310:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789061764.269350:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f139b6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130734080:0@lo:400: 00000100:00100000:1.0:1789061764.269529:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130734208 00000100:00100000:1.0:1789061764.269534:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130734208 00000100:00100000:1.0:1789061764.269571:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061764.269586:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b55d2f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130734208:12345-0@lo:400: 00000100:00100000:1.0:1789061764.269658:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b55d2f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130734208:12345-0@lo:400: Request processed in 74us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061764.269663:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789061764.269845:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002170d085 x1875967130734208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061764.269864:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002170d085 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130734208:0@lo:400: 00010000:00010000:0.0:1789061764.912949:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061765.930591:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061766.954332:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061767.980981:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061769.002990:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061769.385878:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789061769.387886:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061769.387911:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f139b6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130734464:0@lo:400: 00000100:00100000:2.0:1789061769.387975:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061769.390845:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002170d085 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130734336:0@lo:400: 00000100:00100000:0.0:1789061769.390909:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061769.391015:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130734464 00000100:00100000:0.0:1789061769.391023:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130734464 00000100:00100000:0.0:1789061769.391086:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789061769.391101:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003cf139a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130734464:12345-0@lo:400: 00000100:00100000:0.0:1789061769.391154:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003cf139a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130734464:12345-0@lo:400: Request processed in 54us (3179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061769.391161:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789061769.392699:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000f139b6b x1875967130734464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061769.392715:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f139b6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130734464:0@lo:400: 00000100:00100000:2.0:1789061769.394597:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130734336 00000100:00100000:2.0:1789061769.394634:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130734336 00000100:00100000:0.0:1789061769.396408:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789061769.396427:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f5e5cbf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:3621:x1875967130734336:12345-0@lo:400: 00000100:00100000:0.0:1789061769.396512:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f5e5cbf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:3621:x1875967130734336:12345-0@lo:400: Request processed in 88us (5603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061769.396519:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789061769.396566:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002170d085 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130734336:0@lo:400: 00010000:00010000:0.0:1789061770.025817:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789061770.983332:0:7425:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789061770.983336:0:7425:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789061770.983338:0:7425:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789061770.983493:0:7425:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e2ac5696 00000020:01000004:2.0:1789061770.983508:0:7425:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789061770.983518:0:7425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789061770.983531:0:7425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000a57f063c) 00000020:00000080:2.0:1789061770.983551:0:7425:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1789061771.057072:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789061771.068226:0:7425:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1789061771.068288:0:7425:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1789061771.084846:0:7425:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789061771.085077:0:7425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789061771.085087:0:7425:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789061771.085097:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2774d8f311dc635a 00000020:01000004:3.0:1789061771.085104:0:7425:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789061771.085123:0:7425:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789061771.085127:0:7425:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789061771.085132:0:7425:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789061771.085158:0:7425:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789061771.085162:0:7425:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789061771.107008:0:7425:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789061771.107167:0:7425:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1789061771.107172:0:7425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789061771.107173:0:7425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789061771.107174:0:7425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061771.107175:0:7425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061771.107177:0:7425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061771.107178:0:7425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061771.107179:0:7425:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789061771.107181:0:7425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789061771.107182:0:7425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789061771.107184:0:7425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061771.107185:0:7425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789061771.107188:0:7425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1789061771.107191:0:7425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789061771.107192:0:7425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789061771.107193:0:7425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061771.107194:0:7425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061771.107195:0:7425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061771.107197:0:7425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061771.107197:0:7425:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789061771.107198:0:7425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789061771.107199:0:7425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789061771.107200:0:7425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061771.107201:0:7425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789061771.107236:0:7425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789061771.107256:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000674d69c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130734592:0@lo:253: 00000100:00100000:2.0:1789061771.107321:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061771.107381:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b70c3aa going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.107646:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130734592 00000100:00100000:3.0:1789061771.107653:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130734592 00000100:00100000:3.0:1789061771.107706:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789061771.107713:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009a9a7892 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:7425:x1875967130734592:12345-0@lo:253: 20000000:01000000:3.0:1789061771.107741:0:6490:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789061771.107745:0:6490:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1789061771.107749:0:6490:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1789061771.107753:0:6490:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1789061771.107786:0:6490:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1789061771.107962:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061771.108113:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789061771.108126:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789061771.108145:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789061771.108171:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789061771.108185:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789061771.108238:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1789061771.108245:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1789061771.108257:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1789061771.108261:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1789061771.108272:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1789061771.108278:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1789061771.108288:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789061771.108307:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789061771.108746:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1789061771.108760:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:3.0:1789061771.108777:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1789061771.108785:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789061771.108799:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1789061771.108805:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:3.0:1789061771.108817:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1789061771.108823:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789061771.108836:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789061771.108852:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789061771.108862:0:6490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789061771.108942:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1789061771.108958:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1789061771.108977:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789061771.109000:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789061771.109017:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1789061771.109027:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1789061771.109049:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789061771.109074:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789061771.109079:0:6490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1789061771.109114:0:6490:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789061771.109121:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1789061771.109809:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789061771.109986:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789061771.110004:0:6490:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.103@tcp for mdt 20000000:01000000:0.0:1789061771.110006:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:0.0:1789061771.110020:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789061771.110026:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789061771.110073:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789061771.110079:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:0.0:1789061771.110095:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789061771.110103:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789061771.110116:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789061771.110130:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1789061771.110178:0:6490:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1789061771.110186:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1789061771.112113:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1789061771.112432:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789061771.112466:0:6490:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.103@tcp for mdt 20000000:01000000:0.0:1789061771.112469:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:0.0:1789061771.112754:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789061771.112763:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789061771.112780:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789061771.112785:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:0.0:1789061771.112809:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789061771.112817:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1789061771.112829:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789061771.112861:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1789061771.112883:0:6490:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789061771.112887:0:6490:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789061771.112890:0:6490:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789061771.112934:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789061771.112936:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789061771.114185:0:7433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789061771.114217:0:7433:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789061771.114231:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789061771.114387:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789061771.114675:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789061771.114699:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789061771.114710:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789061771.114712:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789061771.115843:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789061771.115875:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789061771.115891:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789061771.116174:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789061771.116198:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789061771.116243:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789061771.116257:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789061771.116260:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789061771.116879:0:7435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789061771.116902:0:7435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789061771.116917:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789061771.117199:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1789061771.117217:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1789061771.117232:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1789061771.117244:0:6490:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789061771.117246:0:6490:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789061771.117251:0:6490:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789061771.117257:0:6490:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789061771.117903:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1789061771.118005:0:6490:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789061771.129419:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789061771.129641:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.129661:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000012c88de1/0x2774d8f311dc6296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc628f expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.129678:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005abb0a99/0x2774d8f311dc62b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc62ab expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.129685:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc631b expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.129692:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.129732:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc631b expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.129746:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc631b expref: 12 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061771.129759:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7a363ba pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130734720:0@lo:104: 00000100:00100000:1.0:1789061771.129831:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789061771.129888:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005abb0a99/0x2774d8f311dc62b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc62ab expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.129895:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005abb0a99/0x2774d8f311dc62b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc62ab expref: 12 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061771.129903:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003429f344 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130734848:0@lo:104: 00000100:00100000:1.0:1789061771.129922:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789061771.129945:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000012c88de1/0x2774d8f311dc6296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc628f expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.129952:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000012c88de1/0x2774d8f311dc6296 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc628f expref: 12 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061771.129961:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130734976:0@lo:104: 00000100:00100000:1.0:1789061771.129979:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061771.129989:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 0000000026e6fe4b going to sleep for 11 seconds 00000100:00100000:0.0:1789061771.130004:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130734720 00000100:00100000:0.0:1789061771.130012:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130734720 00000100:00100000:0.0:1789061771.130057:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130734848 00000100:00100000:0.0:1789061771.130061:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130734848 00000100:00100000:0.0:1789061771.130071:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130734976 00000100:00100000:0.0:1789061771.130079:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130734976 00000100:00100000:0.0:1789061771.130111:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061771.130117:0:6479:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789061771.130123:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a58b66ae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:6490:x1875967130734720:12345-0@lo:104: 00000100:00100000:3.0:1789061771.130128:0:6479:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1789061771.130138:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6322 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130204:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789061771.130209:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a58b66ae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:6490:x1875967130734720:12345-0@lo:104: Request processed in 91us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061771.130216:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789061771.130235:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789061771.130240:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d02b5428 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6490:x1875967130734848:12345-0@lo:104: 00010000:00010000:0.0:1789061771.130246:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc62b2 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130277:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789061771.130282:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d02b5428 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6490:x1875967130734848:12345-0@lo:104: Request processed in 43us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061771.130288:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789061771.130304:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789061771.130310:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000828e51c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:6490:x1875967130734976:12345-0@lo:104: 00010000:00010000:0.0:1789061771.130316:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6296 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061771.130321:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7a363ba pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130734720:0@lo:104: 00000100:00100000:3.0:1789061771.130335:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003429f344 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130734848:0@lo:104: 00010000:00010000:0.0:1789061771.130359:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789061771.130365:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000828e51c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:6490:x1875967130734976:12345-0@lo:104: Request processed in 56us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.130370:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130734976:0@lo:104: 00000100:00100000:0.0:1789061771.130374:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789061771.130396:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130404:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789061771.130410:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6322 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130419:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005b8bb7f8 already unused, calling callback (000000006ac241b9) 10000000:00010000:0.0:1789061771.130421:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6322 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130428:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6322 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061771.130434:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6322 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061771.130439:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789061771.130494:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6322 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130500:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061771.130525:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6322 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130532:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 000000005b8bb7f8/0x2774d8f311dc631b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6322 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130544:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789061771.130547:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc62b2 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130552:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000003d150f5 already unused, calling callback (000000006ac241b9) 10000000:00010000:0.0:1789061771.130554:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc62b2 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130567:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc62b2 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061771.130572:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc62b2 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061771.130577:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789061771.130588:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc8e240e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130735104:0@lo:103: 00010000:00010000:0.0:1789061771.130629:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc62b2 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130636:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061771.130643:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc62b2 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130649:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 0000000003d150f5/0x2774d8f311dc62ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc62b2 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130661:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061771.130663:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6296 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130669:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c6930c8b already unused, calling callback (000000006ac241b9) 10000000:00010000:0.0:1789061771.130671:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6296 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130677:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6296 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061771.130683:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6296 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061771.130694:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789061771.130699:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061771.130712:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6296 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130719:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789061771.130736:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789061771.130736:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6296 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061771.130745:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9779729 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130735232:0@lo:103: 00010000:00010000:0.0:1789061771.130746:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000c6930c8b/0x2774d8f311dc628f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6296 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.130766:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061771.130768:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061771.130771:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061771.130775:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061771.130778:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061771.130786:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061771.130797:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de9600a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130735360:0@lo:103: 00000100:00100000:0.0:1789061771.130832:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.131368:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130735104 00000100:00100000:0.0:1789061771.131374:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130735104 00010000:00010000:0.0:1789061771.131396:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc631b expref: 13 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061771.131425:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130735232 00000100:00100000:0.0:1789061771.131428:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130735232 00010000:00010000:0.0:1789061771.131438:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005abb0a99/0x2774d8f311dc62b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc62ab expref: 14 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061771.131448:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130735360 00000100:00100000:0.0:1789061771.131451:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130735360 00010000:00010000:0.0:1789061771.131468:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000012c88de1/0x2774d8f311dc6296 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc628f expref: 15 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061771.131713:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061771.131722:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000f139b6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:3622:x1875967130735104:12345-0@lo:103: 00010000:00010000:1.0:1789061771.131733:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061771.131739:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc631b expref: 15 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.131749:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc631b expref: 15 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.131764:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc631b expref: 15 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.131786:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061771.131827:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000f139b6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:3622:x1875967130735104:12345-0@lo:103: Request processed in 107us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061771.131834:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061771.131853:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789061771.131861:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000973e9353 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:3622:x1875967130735232:12345-0@lo:103: 00010000:00010000:1.0:1789061771.131868:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061771.131872:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005abb0a99/0x2774d8f311dc62b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc62ab expref: 13 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.131879:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005abb0a99/0x2774d8f311dc62b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc62ab expref: 13 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.131888:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005abb0a99/0x2774d8f311dc62b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc62ab expref: 13 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.131896:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061771.131915:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000973e9353 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:3622:x1875967130735232:12345-0@lo:103: Request processed in 57us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061771.131921:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789061771.131932:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789061771.131938:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003874fab2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+11:3621:x1875967130735360:12345-0@lo:103: 00010000:00010000:1.0:1789061771.131944:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061771.131947:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000012c88de1/0x2774d8f311dc6296 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc628f expref: 11 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.131954:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000012c88de1/0x2774d8f311dc6296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc628f expref: 11 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.131967:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012c88de1/0x2774d8f311dc6296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc628f expref: 11 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.131976:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.131982:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.131994:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.131999:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.132005:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.132009:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.132014:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002bbe3e76 already unused, calling callback (00000000c3156870) 00010000:00010000:1.0:1789061771.132017:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.132023:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.132051:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.132068:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061771.132106:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003874fab2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+10:3621:x1875967130735360:12345-0@lo:103: Request processed in 169us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061771.132111:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789061771.132162:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de9600a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130735360:0@lo:103: 00010000:00010000:2.0:1789061771.132207:0:6490:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.132216:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.132222:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6361 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789061771.132237:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789061771.134215:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9779729 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130735232:0@lo:103: 00000100:00100000:3.0:1789061771.134767:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc8e240e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130735104:0@lo:103: 00000100:00100000:3.0:1789061771.135399:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009a9a7892 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+9:7425:x1875967130734592:12345-0@lo:253: Request processed in 27686us (28078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.135410:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789061771.135553:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000674d69c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130734592:0@lo:253: 10000000:01000000:2.0:1789061771.135567:0:7425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789061771.135570:0:7425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789061771.135572:0:7425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789061771.135573:0:7425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061771.135575:0:7425:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789061771.135576:0:7425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061771.135577:0:7425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061771.135578:0:7425:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789061771.135580:0:7425:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789061771.135581:0:7425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061771.135583:0:7425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789061771.135599:0:7425:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e2ac5696 from lustre-MDT0001 10000000:01000000:2.0:1789061771.135696:0:7425:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789061771.135699:0:7425:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789061771.135705:0:7425:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9767f38a8000 local copy 10000000:01000000:2.0:1789061771.135709:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789061771.135751:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.135762:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.135770:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061771.135786:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000674d69c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130735488:0@lo:101: 00000100:00100000:2.0:1789061771.135817:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061771.135850:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 000000001efa5569 going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.136039:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130735488 00000100:00100000:3.0:1789061771.136051:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130735488 00000100:00100000:3.0:1789061771.136090:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789061771.136106:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005f115a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+9:7425:x1875967130735488:12345-0@lo:101: 00010000:00010000:3.0:1789061771.136118:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061771.136129:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000070b0d2f8/0x2774d8f311dc636f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6368 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.136150:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000070b0d2f8/0x2774d8f311dc636f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6368 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.136159:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000070b0d2f8/0x2774d8f311dc636f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6368 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.136168:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000070b0d2f8, rc 0) 00000100:00100000:3.0:1789061771.136204:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005f115a81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+10:7425:x1875967130735488:12345-0@lo:101: Request processed in 100us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.136210:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789061771.136513:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000674d69c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130735488:0@lo:101: 00010000:00010000:2.0:1789061771.136526:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2774d8f311dc636f expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.136534:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2774d8f311dc636f expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061771.136644:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000674d69c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130735616:0@lo:501: 00000100:00100000:2.0:1789061771.136769:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061771.136791:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 000000001efa5569 going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.136849:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130735616 00000100:00100000:3.0:1789061771.136854:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130735616 00000100:00100000:3.0:1789061771.136916:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789061771.136922:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000beb6e4e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+10:7425:x1875967130735616:12345-0@lo:501: 00000100:00100000:3.0:1789061771.136985:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000beb6e4e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+10:7425:x1875967130735616:12345-0@lo:501: Request processed in 64us (216us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789061771.136992:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789061771.140335:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000674d69c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130735616:0@lo:501: 10000000:01000000:2.0:1789061771.140369:0:7425:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789061771.140415:0:7425:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789061771.140423:0:7425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2774d8f311dc636f expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.140432:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2774d8f311dc636f expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.140453:0:7425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2774d8f311dc636f expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.140477:0:7425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789061771.140506:0:7425:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9767fb057800 10000000:01000000:2.0:1789061771.140511:0:7425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789061771.140515:0:7425:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9767f38a8000 10000000:01000000:2.0:1789061771.140518:0:7425:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789061771.140521:0:7425:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9767f38a8000 from 1 10000000:01000000:2.0:1789061771.140524:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789061771.140556:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 0000000095d62a6d/0x2774d8f311dc6376 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.140563:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 0000000095d62a6d/0x2774d8f311dc6376 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.140572:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 0000000095d62a6d/0x2774d8f311dc6376 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061771.140590:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000674d69c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130735744:0@lo:101: 00010000:00010000:0.0:1789061771.140599:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061771.140624:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2774d8f311dc636f expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.140634:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b348ff84 already unused, calling callback (000000006ac241b9) 10000000:00010000:0.0:1789061771.140637:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2774d8f311dc636f expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.140645:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2774d8f311dc636f expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061771.140654:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2774d8f311dc636f expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061771.140659:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789061771.140682:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2774d8f311dc636f expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.140688:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061771.140720:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2774d8f311dc636f expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.140726:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000b348ff84/0x2774d8f311dc6368 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2774d8f311dc636f expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.140744:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061771.140746:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061771.140757:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061771.140768:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061771.140780:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de9600a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130735872:0@lo:103: 00000100:00100000:0.0:1789061771.140814:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061771.140821:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061771.140861:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130735872 00000100:00100000:1.0:1789061771.140873:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130735872 00000100:00100000:3.0:1789061771.140896:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130735744 00000100:00100000:3.0:1789061771.140902:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130735744 00000100:00100000:3.0:1789061771.140936:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789061771.140942:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb3aad45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+11:7425:x1875967130735744:12345-0@lo:101: 00010000:00010000:3.0:1789061771.140954:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061771.140971:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068de4588/0x2774d8f311dc637d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6376 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.140991:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068de4588/0x2774d8f311dc637d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6376 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.141001:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068de4588/0x2774d8f311dc637d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6376 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.141009:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068de4588, rc 0) 00000100:00100000:3.0:1789061771.141051:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb3aad45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:7425:x1875967130735744:12345-0@lo:101: Request processed in 108us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.141057:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789061771.141203:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061771.141213:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000699a11ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+11:3620:x1875967130735872:12345-0@lo:103: 00010000:00010000:1.0:1789061771.141224:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061771.141235:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000070b0d2f8/0x2774d8f311dc636f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc6368 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061771.141247:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061771.141744:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000029cf7b7 going to sleep for 11 seconds 00000100:00100000:2.0:1789061771.141762:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000674d69c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130735744:0@lo:101: 00010000:00010000:2.0:1789061771.141775:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 0000000095d62a6d/0x2774d8f311dc6376 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc637d expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.141784:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 0000000095d62a6d/0x2774d8f311dc6376 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc637d expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061771.141811:0:7425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789061771.141866:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 0000000095d62a6d/0x2774d8f311dc6376 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc637d expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.141874:0:7425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 0000000095d62a6d/0x2774d8f311dc6376 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc637d expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061771.141883:0:7425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9767fb057800 10000000:01000000:2.0:1789061771.141887:0:7425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789061771.141891:0:7425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9767fb057800 from 1 10000000:01000000:2.0:1789061771.141894:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00000100:00100000:1.0:1789061771.141909:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000699a11ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+10:3620:x1875967130735872:12345-0@lo:103: Request processed in 697us (1094us total) trans 0 rc 0/0 00010000:00010000:2.0:1789061771.141912:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000b155fa25/0x2774d8f311dc6384 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.141921:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000b155fa25/0x2774d8f311dc6384 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.141927:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000b155fa25/0x2774d8f311dc6384 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061771.141938:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000674d69c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130736000:0@lo:101: 00000100:00100000:2.0:1789061771.141966:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061771.141986:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000029cf7b7 going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.142041:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130736000 00000100:00100000:3.0:1789061771.142046:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130736000 00000100:00100000:3.0:1789061771.142112:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789061771.142118:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000697c6a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+11:7425:x1875967130736000:12345-0@lo:101: 00010000:00010000:3.0:1789061771.142126:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061771.142133:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000057b24a49/0x2774d8f311dc638b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6384 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.142146:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000057b24a49/0x2774d8f311dc638b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6384 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.142153:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000057b24a49/0x2774d8f311dc638b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6384 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.142160:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000057b24a49, rc 0) 00000100:00100000:3.0:1789061771.142187:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000697c6a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:7425:x1875967130736000:12345-0@lo:101: Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.142201:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789061771.142395:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000674d69c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130736000:0@lo:101: 00010000:00010000:3.0:1789061771.142405:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000b155fa25/0x2774d8f311dc6384 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.142412:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000b155fa25/0x2774d8f311dc6384 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061771.142421:0:7425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789061771.142468:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000b155fa25/0x2774d8f311dc6384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.142476:0:7425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000b155fa25/0x2774d8f311dc6384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061771.142481:0:7425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789061771.142485:0:7425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789061771.142489:0:7425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9767fb057800 10000000:01000000:3.0:1789061771.142491:0:7425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789061771.142494:0:7425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789061771.142496:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789061771.142509:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000003c258a1c/0x2774d8f311dc6392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.142515:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000003c258a1c/0x2774d8f311dc6392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.142521:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000003c258a1c/0x2774d8f311dc6392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061771.142541:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0789635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130736128:0@lo:101: 00000100:00100000:3.0:1789061771.142565:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061771.142587:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130736128 00000100:00100000:3.0:1789061771.142603:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130736128 00000100:00100000:3.0:1789061771.142655:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789061771.142660:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000058a97a9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:7425:x1875967130736128:12345-0@lo:101: 00010000:00010000:3.0:1789061771.142667:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061771.142686:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000076b705a1/0x2774d8f311dc6399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6392 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.142699:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076b705a1/0x2774d8f311dc6399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6392 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.142708:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000076b705a1/0x2774d8f311dc6399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6392 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.142713:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000076b705a1, rc 0) 00000100:00100000:3.0:1789061771.142736:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000058a97a9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:7425:x1875967130736128:12345-0@lo:101: Request processed in 76us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.142741:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789061771.142770:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ce838b97 going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.142781:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0789635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130736128:0@lo:101: 00010000:00010000:3.0:1789061771.142791:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000003c258a1c/0x2774d8f311dc6392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6399 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.142797:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000003c258a1c/0x2774d8f311dc6392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6399 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061771.142884:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0789635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130736256:0@lo:501: 00000100:00100000:3.0:1789061771.142906:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061771.142920:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e050ded9 going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.142931:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130736256 00000100:00100000:3.0:1789061771.142935:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130736256 00000100:00100000:3.0:1789061771.142955:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789061771.142960:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000af519b0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:7425:x1875967130736256:12345-0@lo:501: 00000100:00100000:3.0:1789061771.143051:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000af519b0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:7425:x1875967130736256:12345-0@lo:501: Request processed in 91us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.143059:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789061771.143099:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0789635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130736256:0@lo:501: 00000100:00100000:3.0:1789061771.143121:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0789635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130736384:0@lo:503: 00000100:00100000:3.0:1789061771.143160:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061771.143179:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130736384 00000100:00100000:3.0:1789061771.143182:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130736384 00000100:00100000:3.0:1789061771.143201:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789061771.143206:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000528cab17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:7425:x1875967130736384:12345-0@lo:503: 00000100:00100000:3.0:1789061771.143276:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000528cab17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:7425:x1875967130736384:12345-0@lo:503: Request processed in 70us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.143283:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789061771.143501:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e050ded9 going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.143514:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0789635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130736384:0@lo:503: 00000040:00080000:3.0:1789061771.143959:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789061771.144015:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0789635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130736512:0@lo:502: 00000100:00100000:3.0:1789061771.144066:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061771.144091:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e050ded9 going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.144107:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130736512 00000100:00100000:3.0:1789061771.144111:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130736512 00000100:00100000:3.0:1789061771.144137:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789061771.144143:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b5f2f8a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:7425:x1875967130736512:12345-0@lo:502: 00000100:00100000:3.0:1789061771.144217:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b5f2f8a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:7425:x1875967130736512:12345-0@lo:502: Request processed in 75us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.144385:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789061771.144428:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0789635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130736512:0@lo:502: 00000040:00080000:3.0:1789061771.144745:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789061771.144769:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1789061771.144782:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1789061771.144793:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1789061771.144804:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1789061771.144817:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1789061771.144828:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1789061771.144839:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1789061771.144849:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1789061771.144861:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1789061771.144872:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1789061771.144883:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1789061771.144894:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1789061771.144905:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1789061771.144917:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1789061771.144928:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1789061771.144940:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1789061771.144951:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1789061771.144962:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1789061771.144984:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1789061771.145003:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1789061771.145014:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1789061771.145025:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1789061771.145057:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0789635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130736640:0@lo:502: 00000100:00100000:3.0:1789061771.145388:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061771.145395:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061771.145461:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de9600a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130735872:0@lo:103: 00000100:00100000:3.0:1789061771.145471:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e050ded9 going to sleep for 11 seconds 00000100:00100000:2.0:1789061771.145522:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130736640 00000100:00100000:2.0:1789061771.145528:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130736640 00000100:00100000:2.0:1789061771.145623:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789061771.145631:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001ef74a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:7425:x1875967130736640:12345-0@lo:502: 00000100:00100000:2.0:1789061771.145835:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001ef74a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:7425:x1875967130736640:12345-0@lo:502: Request processed in 205us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061771.145849:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789061771.145970:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0789635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130736640:0@lo:502: 00000040:00080000:0.0:1789061771.146027:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1789061771.146050:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1789061771.147138:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061771.147150:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061771.147152:0:7438:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789061771.147158:0:7438:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789061771.147161:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789061771.147174:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000030f967e3) 00000020:00000080:2.0:1789061771.147206:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1789061771.147214:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789061771.148222:0:7438:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789061771.148233:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2774d8f311dc63a7 00000020:00000080:2.0:1789061771.148555:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789061771.148562:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061771.148567:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061771.148569:0:7438:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789061771.148572:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061771.148576:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061771.148578:0:7438:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789061771.148582:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789061771.148591:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000025259c9) 00000020:00000080:2.0:1789061771.148817:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1789061771.148837:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789061771.148839:0:7438:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789061771.148842:0:7438:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789061771.148848:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789061771.149202:0:7438:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e2ac5696 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789061771.149229:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000067f70096) 00000020:00000080:2.0:1789061771.149239:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1789061771.149707:0:7438:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789061771.149714:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc63bc 00000020:00000080:2.0:1789061771.149822:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789061771.149829:0:7438:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789061771.149839:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2774d8f311dc63c3 00080000:01000000:2.0:1789061771.149846:0:7438:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789061771.149849:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2774d8f311dc63ca 00080000:10000000:2.0:1789061771.151144:0:7438:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789061771.151706:0:7438:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1789061771.282351:0:7438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1789061771.282757:0:7438:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1789061771.286254:0:7438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789061771.288802:0:7438:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789061771.309267:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789061771.309280:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061771.309286:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061771.309288:0:7438:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789061771.309292:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061771.309297:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061771.309299:0:7438:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789061771.309303:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789061771.309308:0:7438:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:1.0:1789061771.309331:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789061771.309343:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000003a5a37e2) 00000020:00000080:1.0:1789061771.309368:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789061771.309375:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789061771.309458:0:7438:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789061771.309465:0:7438:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789061771.309473:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2774d8f311dc63d8 00010000:00080000:1.0:1789061771.309513:0:7438:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008a72b76a@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1789061771.314691:0:7438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1789061771.317155:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789061771.317168:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789061771.317202:0:7438:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789061771.317221:0:7438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc63df 00000100:00080000:1.0:1789061771.317231:0:7438:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789061771.317241:0:7438:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000008a72b76a using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789061771.317274:0:7438:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000091e0178b x1875967130736768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789061771.317299:0:7438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789061771.317351:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061771.317355:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061771.317357:0:7438:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789061771.317360:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789061771.317362:0:7438:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789061771.317363:0:7438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789061771.317365:0:7438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789061771.317366:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789061771.317368:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061771.317370:0:7438:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789061771.317372:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061771.317376:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061771.317378:0:7438:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789061771.317381:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789061771.317529:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b5b5c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130736896:0@lo:400: 00000100:00100000:2.0:1789061771.317589:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061771.317668:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130736896 00000100:00100000:2.0:1789061771.317675:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130736896 00000100:00100000:2.0:1789061771.317715:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061771.317723:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007533060f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130736896:12345-0@lo:400: 00000100:00100000:2.0:1789061771.317769:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007533060f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130736896:12345-0@lo:400: Request processed in 46us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061771.317775:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789061771.317808:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b7b5b5c2 x1875967130736896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061771.317821:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b5b5c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130736896:0@lo:400: 00000004:01000000:1.0:1789061771.317943:0:7438:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789061771.317972:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061771.317975:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061771.317977:0:7438:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789061771.317979:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061771.317982:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061771.317983:0:7438:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789061771.317986:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789061771.317987:0:7438:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789061771.318012:0:7438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061771.318015:0:7438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061771.318016:0:7438:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789061771.318018:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1789061771.318278:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000091e0178b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130736768:0@lo:38: 00000100:00100000:3.0:1789061771.318356:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789061771.318552:0:7425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1789061771.318582:0:7425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789061771.318601:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000003c258a1c/0x2774d8f311dc6392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6399 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.318638:0:7425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000003c258a1c/0x2774d8f311dc6392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6399 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061771.318646:0:7425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767fb057800 from 1 10000000:01000000:2.0:1789061771.318656:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789061771.318681:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.318689:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.318697:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061771.318711:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b5b5c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737024:0@lo:101: 00000100:00100000:2.0:1789061771.318739:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061771.318755:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000907385ec going to sleep for 11 seconds 00000100:00100000:2.0:1789061771.318774:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130737024 00000100:00100000:2.0:1789061771.318779:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130737024 00000100:00100000:2.0:1789061771.318807:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789061771.318813:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000addf7149 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+12:7425:x1875967130737024:12345-0@lo:101: 00010000:00010000:2.0:1789061771.318821:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061771.318832:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f16e554d/0x2774d8f311dc63ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc63e6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.318850:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f16e554d/0x2774d8f311dc63ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc63e6 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.318859:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f16e554d/0x2774d8f311dc63ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc63e6 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.318866:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f16e554d, rc 0) 00000100:00100000:2.0:1789061771.318895:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000addf7149 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:7425:x1875967130737024:12345-0@lo:101: Request processed in 82us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061771.318911:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789061771.318951:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b5b5c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737024:0@lo:101: 00010000:00010000:2.0:1789061771.318963:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc63ed expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.318969:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc63ed expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061771.319647:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130736768 00000100:00100000:1.0:1789061771.319654:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130736768 00000100:00100000:1.0:1789061771.319675:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061771.319680:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000009372399 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875967130736768:12345-0@lo:38: 00010000:00080000:1.0:1789061771.319701:0:6501:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:1.0:1789061771.319732:0:6501:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc63f4 00000004:00100000:1.0:1789061771.319745:0:6501:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789061771.319750:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789061771.320038:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b5b5c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737152:0@lo:256: 00000100:00100000:2.0:1789061771.320276:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061771.320339:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000907385ec going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.321186:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130737152 00000100:00100000:3.0:1789061771.321194:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130737152 00000100:00100000:3.0:1789061771.321263:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789061771.321271:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cad676e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:7425:x1875967130737152:12345-0@lo:256: 20000000:01000000:3.0:1789061771.321287:0:6491:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789061771.321308:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789061771.321311:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789061771.321426:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cad676e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:7425:x1875967130737152:12345-0@lo:256: Request processed in 156us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.321433:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789061771.321506:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b5b5c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737152:0@lo:256: 10000000:01000000:0.0:1789061771.322101:0:7425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789061771.322119:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc63ed expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.322130:0:7425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc63ed expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061771.322139:0:7425:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fb057800 from 1 10000000:01000000:0.0:1789061771.322142:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789061771.322168:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.322175:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.322183:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061771.322199:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737280:0@lo:101: 00000100:00100000:0.0:1789061771.322232:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.322760:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de606b25 going to sleep for 11 seconds 00000100:00100000:2.0:1789061771.323590:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130737280 00000100:00100000:2.0:1789061771.323599:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130737280 00000100:00100000:2.0:1789061771.323665:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789061771.323672:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098efbfa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:7425:x1875967130737280:12345-0@lo:101: 00010000:00010000:2.0:1789061771.323685:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061771.323700:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b348ff84/0x2774d8f311dc6402 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc63fb expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.323724:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b348ff84/0x2774d8f311dc6402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc63fb expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.323735:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b348ff84/0x2774d8f311dc6402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc63fb expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.323744:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b348ff84, rc 0) 00000100:00100000:2.0:1789061771.323796:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098efbfa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:7425:x1875967130737280:12345-0@lo:101: Request processed in 124us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061771.323815:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789061771.323915:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737280:0@lo:101: 00010000:00010000:0.0:1789061771.323930:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6402 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.323938:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6402 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061771.324044:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737408:0@lo:501: 00000100:00100000:0.0:1789061771.324074:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.324102:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de606b25 going to sleep for 11 seconds 00000100:00100000:2.0:1789061771.324172:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130737408 00000100:00100000:2.0:1789061771.324177:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130737408 00000100:00100000:2.0:1789061771.324194:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789061771.324198:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c0d2a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:7425:x1875967130737408:12345-0@lo:501: 00000100:00100000:2.0:1789061771.324295:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c0d2a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:7425:x1875967130737408:12345-0@lo:501: Request processed in 96us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061771.324302:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789061771.324360:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737408:0@lo:501: 00000100:00100000:0.0:1789061771.324383:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737536:0@lo:503: 00000100:00100000:0.0:1789061771.324431:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.324455:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de606b25 going to sleep for 11 seconds 00000100:00100000:2.0:1789061771.324621:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130737536 00000100:00100000:2.0:1789061771.324625:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130737536 00000100:00100000:2.0:1789061771.324643:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789061771.324648:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8a4b23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:7425:x1875967130737536:12345-0@lo:503: 00000040:00080000:2.0:1789061771.324676:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789061771.324709:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8a4b23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:7425:x1875967130737536:12345-0@lo:503: Request processed in 60us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061771.324716:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789061771.324909:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737536:0@lo:503: 00000040:00080000:0.0:1789061771.325159:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061771.325209:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1789061771.325279:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1789061771.327431:0:6501:0:(import.c:65:import_set_state_nolock()) 000000007fc138e8 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061771.327588:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000009372399 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1875967130736768:12345-0@lo:38: Request processed in 7905us (9229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.327652:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789061771.327834:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789061771.327843:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789061771.327851:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789061771.327855:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789061771.327857:0:3619:0:(import.c:65:import_set_state_nolock()) 000000008a72b76a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789061771.327867:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000091e0178b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130736768:0@lo:38: 00000100:00100000:1.0:1789061771.328005:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061771.328017:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d15a4cf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130737664:0@lo:41: 00000100:00100000:1.0:1789061771.328067:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061771.328164:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130737664 00000100:00100000:3.0:1789061771.328171:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130737664 00000100:00100000:3.0:1789061771.328209:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061771.328217:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006aabf879 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875967130737664:12345-0@lo:41: 00000004:00000024:3.0:1789061771.328252:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789061771.328331:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006aabf879 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875967130737664:12345-0@lo:41: Request processed in 115us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.328337:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789061771.328406:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d15a4cf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130737664:0@lo:41: 00000040:00080000:2.0:1789061771.329744:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1789061771.329913:0:7425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789061771.329949:0:7425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789061771.329998:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6402 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.330010:0:7425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6402 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061771.330067:0:7425:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789061771.330070:0:7425:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9767fb057800 10000000:01000000:0.0:1789061771.330073:0:7425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9767fb057800 10000000:01000000:0.0:1789061771.330077:0:7425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789061771.330082:0:7425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767fb057800 from 1 10000000:01000000:0.0:1789061771.330085:0:7425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789061771.330111:0:7425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000222eb40a/0x2774d8f311dc6409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.330119:0:7425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000222eb40a/0x2774d8f311dc6409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.330128:0:7425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000222eb40a/0x2774d8f311dc6409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061771.330145:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737792:0@lo:101: 00000100:00100000:0.0:1789061771.330194:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.330228:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f6afe1c3 going to sleep for 11 seconds 00000100:00100000:2.0:1789061771.330274:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130737792 00000100:00100000:2.0:1789061771.330280:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130737792 00000100:00100000:2.0:1789061771.330318:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789061771.330325:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae43e756 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:7425:x1875967130737792:12345-0@lo:101: 00010000:00010000:2.0:1789061771.330336:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061771.330347:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6409 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.330368:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6409 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.330389:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c6260e6/0x2774d8f311dc6410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6409 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.330397:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c6260e6, rc 0) 00000100:00100000:2.0:1789061771.330444:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae43e756 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7425:x1875967130737792:12345-0@lo:101: Request processed in 120us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061771.330451:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789061771.330569:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737792:0@lo:101: 00010000:00010000:0.0:1789061771.330582:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000222eb40a/0x2774d8f311dc6409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6410 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.330591:0:7425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000222eb40a/0x2774d8f311dc6409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6410 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061771.330703:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737920:0@lo:501: 00000100:00100000:0.0:1789061771.330728:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.330751:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f6afe1c3 going to sleep for 11 seconds 00000100:00100000:2.0:1789061771.330860:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130737920 00000100:00100000:2.0:1789061771.330865:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130737920 00000100:00100000:2.0:1789061771.330898:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789061771.330905:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005271a2e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7425:x1875967130737920:12345-0@lo:501: 00000100:00100000:2.0:1789061771.330992:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005271a2e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7425:x1875967130737920:12345-0@lo:501: Request processed in 88us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061771.330999:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789061771.331063:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130737920:0@lo:501: 00000100:00100000:0.0:1789061771.331088:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130738048:0@lo:503: 00000100:00100000:0.0:1789061771.331125:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.331145:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f6afe1c3 going to sleep for 11 seconds 00000100:00100000:2.0:1789061771.331183:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130738048 00000100:00100000:2.0:1789061771.331187:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130738048 00000100:00100000:2.0:1789061771.331213:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789061771.331218:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a8fb46c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7425:x1875967130738048:12345-0@lo:503: 00000100:00100000:2.0:1789061771.331284:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a8fb46c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7425:x1875967130738048:12345-0@lo:503: Request processed in 66us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061771.331292:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789061771.331415:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130738048:0@lo:503: 00000040:00080000:0.0:1789061771.331799:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789061771.331859:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130738176:0@lo:502: 00000100:00100000:0.0:1789061771.331898:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.331923:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f6afe1c3 going to sleep for 11 seconds 00000100:00100000:2.0:1789061771.332015:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130738176 00000100:00100000:2.0:1789061771.332020:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130738176 00000100:00100000:2.0:1789061771.332061:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789061771.332068:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf46cefb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7425:x1875967130738176:12345-0@lo:502: 00000100:00100000:2.0:1789061771.332148:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf46cefb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7425:x1875967130738176:12345-0@lo:502: Request processed in 81us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061771.332160:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789061771.332263:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130738176:0@lo:502: 00000040:00080000:0.0:1789061771.332468:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789061771.332658:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789061771.332676:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789061771.332689:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789061771.332701:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789061771.332713:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789061771.332725:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789061771.332735:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789061771.332746:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789061771.332758:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789061771.332771:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789061771.332783:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789061771.332793:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789061771.332818:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789061771.332831:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789061771.332845:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789061771.332857:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789061771.332870:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789061771.332883:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789061771.332895:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789061771.332906:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789061771.332918:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789061771.332949:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789061771.332967:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789061771.332979:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789061771.332991:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789061771.333003:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789061771.333015:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1789061771.333048:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130738304:0@lo:502: 00000100:00100000:0.0:1789061771.333094:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.333119:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f6afe1c3 going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.333183:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130738304 00000100:00100000:3.0:1789061771.333189:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130738304 00000100:00100000:3.0:1789061771.333224:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789061771.333231:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009db8f76e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7425:x1875967130738304:12345-0@lo:502: 00000100:00100000:3.0:1789061771.333311:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009db8f76e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7425:x1875967130738304:12345-0@lo:502: Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.333317:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789061771.334738:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130738304:0@lo:502: 00000040:00080000:0.0:1789061771.334808:0:7425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789061771.334819:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789061771.335318:0:7444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789061771.335333:0:7444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000cac2e33b) 00000020:00000080:3.0:1789061771.335351:0:7444:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789061771.335560:0:7444:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e2ac5696 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789061771.335564:0:7444:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e2ac5696 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789061771.335566:0:7444:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e2ac5696 3 00010000:00080000:3.0:1789061771.335595:0:7444:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f8710b74@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1789061771.337896:0:7444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1789061771.338151:0:7444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789061771.338192:0:7444:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789061771.338204:0:7444:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2774d8f311dc641e 00000100:00080000:3.0:1789061771.338215:0:7444:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789061771.338224:0:7444:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000f8710b74 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1789061771.338259:0:7444:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000065569ddb x1875967130738432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789061771.338316:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065569ddb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875967130738432:0@lo:38: 00000100:00100000:1.0:1789061771.338381:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789061771.338448:0:7444:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789061771.338770:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130738432 00000100:00100000:2.0:1789061771.338778:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130738432 00000100:00100000:2.0:1789061771.338808:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061771.338815:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b277b59f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875967130738432:12345-0@lo:38: 00010000:00080000:2.0:1789061771.338837:0:6497:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:2.0:1789061771.338867:0:6497:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2774d8f311dc6425 00000004:00100000:2.0:1789061771.338879:0:6497:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789061771.338907:0:6497:0:(import.c:65:import_set_state_nolock()) 00000000931af409 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1789061771.341676:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1789061771.341817:0:7445:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1789061771.342005:0:7425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789061771.342050:0:7425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789061771.342073:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000222eb40a/0x2774d8f311dc6409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6410 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.342085:0:7425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000222eb40a/0x2774d8f311dc6409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6410 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789061771.342129:0:7425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789061771.342134:0:7425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789061771.342135:0:7425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061771.342136:0:7425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061771.342137:0:7425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061771.342139:0:7425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061771.342140:0:7425:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789061771.342141:0:7425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789061771.342142:0:7425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789061771.342143:0:7425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061771.342145:0:7425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789061771.342148:0:7425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1789061771.342151:0:7425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789061771.342152:0:7425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789061771.342153:0:7425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061771.342153:0:7425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061771.342154:0:7425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061771.342155:0:7425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061771.342156:0:7425:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789061771.342157:0:7425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789061771.342158:0:7425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789061771.342158:0:7425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061771.342159:0:7425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789061771.342183:0:7425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789061771.342200:0:7425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130738560:0@lo:253: 00000100:00100000:0.0:1789061771.342262:0:7425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.342294:0:7425:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de606b25 going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.343600:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130738560 00000100:00100000:3.0:1789061771.343624:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130738560 00000100:00100000:3.0:1789061771.343667:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789061771.343675:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec3fe7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7425:x1875967130738560:12345-0@lo:253: 20000000:01000000:3.0:1789061771.343701:0:6491:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789061771.343712:0:6491:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789061771.347059:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b277b59f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875967130738432:12345-0@lo:38: Request processed in 8238us (8672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061771.347073:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789061771.347186:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000065569ddb x1875967130738432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789061781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061771.347200:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789061771.347210:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789061771.347226:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789061771.347231:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789061771.347234:0:3619:0:(import.c:65:import_set_state_nolock()) 00000000f8710b74 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789061771.347241:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065569ddb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875967130738432:0@lo:38: 00000001:00100000:2.0:1789061771.348554:0:6474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789061771.348794:0:6491:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789061771.348833:0:6491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789061771.349121:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec3fe7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7425:x1875967130738560:12345-0@lo:253: Request processed in 5444us (6857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.349132:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 20000000:01000000:2.0:1789061771.349187:0:6512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789061771.349192:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789061771.349209:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.349223:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000573406aa/0x2774d8f311dc6345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc633e expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.349230:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f16e554d/0x2774d8f311dc63ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc63e6 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.349236:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.349270:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f16e554d/0x2774d8f311dc63ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc63e6 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.349297:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f16e554d/0x2774d8f311dc63ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc63e6 expref: 14 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061771.349309:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3b0cbb2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130738688:0@lo:104: 00000100:00100000:2.0:1789061771.349345:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061771.349474:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000573406aa/0x2774d8f311dc6345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc633e expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.350563:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000573406aa/0x2774d8f311dc6345 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc633e expref: 14 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061771.350576:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ccc73e0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130738816:0@lo:104: 00000100:00100000:2.0:1789061771.350629:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.350691:0:7425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7425:1875967130738560:0@lo:253: 10000000:01000000:0.0:1789061771.350706:0:7425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789061771.350709:0:7425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789061771.350711:0:7425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789061771.350712:0:7425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061771.350713:0:7425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061771.350714:0:7425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061771.350716:0:7425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061771.350717:0:7425:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789061771.350719:0:7425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789061771.350720:0:7425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789061771.350721:0:7425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061771.350732:0:7425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789061771.350744:0:7425:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789061771.354595:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a961be5 going to sleep for 11 seconds 00000100:00100000:1.0:1789061771.354749:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130738688 00000100:00100000:1.0:1789061771.354759:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130738688 00000100:00100000:3.0:1789061771.354834:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130738816 00000100:00100000:3.0:1789061771.354839:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130738816 00000100:00100000:3.0:1789061771.354877:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789061771.354885:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e5ced544 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6512:x1875967130738688:12345-0@lo:104: 00010000:00010000:3.0:1789061771.354900:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc63ed expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.354978:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789061771.354983:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e5ced544 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6512:x1875967130738688:12345-0@lo:104: Request processed in 100us (5639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.354989:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789061771.355005:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789061771.355010:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007866a3d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:6512:x1875967130738816:12345-0@lo:104: 00010000:00010000:3.0:1789061771.355016:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6345 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061771.355056:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789061771.355074:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007866a3d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:6512:x1875967130738816:12345-0@lo:104: Request processed in 65us (4445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.355079:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789061771.355339:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789061771.355345:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc63ed expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.355353:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f6a9e3a5 already unused, calling callback (000000006ac241b9) 10000000:00010000:0.0:1789061771.355356:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc63ed expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.355363:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc63ed expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061771.355370:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc63ed expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061771.355376:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789061771.355414:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc63ed expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.355421:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061771.355439:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc63ed expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.355445:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000f6a9e3a5/0x2774d8f311dc63e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc63ed expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.355456:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061771.355458:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6345 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.355464:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d90cdac4 already unused, calling callback (000000006ac241b9) 10000000:00010000:0.0:1789061771.355472:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6345 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.355478:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6345 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061771.355495:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6345 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061771.355500:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789061771.355514:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6345 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.355520:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061771.355524:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6345 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.355529:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000d90cdac4/0x2774d8f311dc633e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6345 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.355541:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061771.355543:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061771.355544:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061771.355550:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061771.355812:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130738944:0@lo:103: 00000100:00100000:0.0:1789061771.355854:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.355886:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061771.355892:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c983a5e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130739072:0@lo:103: 00000100:00100000:0.0:1789061771.355915:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.356113:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130738944 00000100:00100000:0.0:1789061771.356125:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130738944 00010000:00010000:0.0:1789061771.356145:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f16e554d/0x2774d8f311dc63ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc63e6 expref: 15 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061771.356167:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130739072 00000100:00100000:0.0:1789061771.356170:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130739072 00010000:00010000:0.0:1789061771.356181:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000573406aa/0x2774d8f311dc6345 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc633e expref: 16 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061771.356194:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789061771.356200:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c92bf9dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:3620:x1875967130738944:12345-0@lo:103: 00010000:00010000:0.0:1789061771.356210:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061771.356214:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f16e554d/0x2774d8f311dc63ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc63e6 expref: 16 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.356224:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f16e554d/0x2774d8f311dc63ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc63e6 expref: 16 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.356239:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061771.356270:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c92bf9dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:3620:x1875967130738944:12345-0@lo:103: Request processed in 70us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061771.356277:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789061771.356291:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789061771.356295:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000357e08c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:3620:x1875967130739072:12345-0@lo:103: 00010000:00010000:0.0:1789061771.356302:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061771.356305:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000573406aa/0x2774d8f311dc6345 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc633e expref: 15 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.356311:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000573406aa/0x2774d8f311dc6345 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc633e expref: 15 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.356330:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.356337:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789061771.356351:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007160002s 00010000:00010000:0.0:1789061771.356355:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.356361:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.356368:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.356373:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.356378:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ed7f198d already unused, calling callback (00000000c3156870) 00010000:00010000:0.0:1789061771.356381:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.356386:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.356393:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061771.356402:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061771.356424:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000357e08c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:3620:x1875967130739072:12345-0@lo:103: Request processed in 128us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061771.356435:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789061771.356492:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c983a5e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130739072:0@lo:103: 00000100:00100000:0.0:1789061771.356501:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130738944:0@lo:103: 00080000:10000000:0.0:1789061771.357260:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1789061771.357455:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789061771.357678:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789061771.357870:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00010000:00010000:2.0:1789061771.358334:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f16e554d/0x2774d8f311dc63ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc63e6 expref: 14 pid: 6490 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061771.358350:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3b0cbb2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130738688:0@lo:104: 00010000:00010000:2.0:1789061771.358361:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000573406aa/0x2774d8f311dc6345 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc633e expref: 13 pid: 6491 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061771.358370:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ccc73e0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130738816:0@lo:104: 00010000:00010000:2.0:1789061771.358386:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.358395:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.358432:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061771.358437:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ed7f198d/0x2774d8f311dc642c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789061771.358657:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789061771.358843:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789061771.359470:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789061771.359739:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789061771.359925:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789061771.360107:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789061771.360280:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1789061771.360451:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1789061771.362302:0:7425:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1789061771.362738:0:7450:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1789061771.362789:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008231d083 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7450:1875967130739200:0@lo:700: 00000100:00100000:1.0:1789061771.362848:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061771.362886:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b7cfd9e3 going to sleep for 11 seconds 00000040:01000000:2.0:1789061771.362936:0:7425:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789061771.363055:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130739200 00000100:00100000:0.0:1789061771.363064:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130739200 00000100:00100000:0.0:1789061771.363111:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789061771.363120:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000876c21bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7450:x1875967130739200:12345-0@lo:700: 00000020:00080000:3.0:1789061771.363578:0:7449:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789061771.363583:0:7449:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789061771.363855:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875967130739328:0@lo:1000: 00000100:00100000:0.0:1789061771.363896:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.363949:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d738e44 going to sleep for 11 seconds 00000040:01000000:0.0:1789061771.364276:0:7425:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789061771.364376:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789061771.364971:0:7425:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789061771.364981:0:7425:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789061771.365139:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061771.367288:0:7425:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1789061771.367726:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130739328 00000100:00100000:3.0:1789061771.367736:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130739328 00000100:00100000:3.0:1789061771.367782:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061771.367789:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c983a5e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1875967130739328:12345-0@lo:1000: 00000100:00100000:3.0:1789061771.367898:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c983a5e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1875967130739328:12345-0@lo:1000: Request processed in 110us (4002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.367905:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1789061771.368490:0:7425:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789061771.368565:0:7425:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789061771.368784:0:7425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789061771.369012:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875967130739328:0@lo:1000: 00000040:01000000:1.0:1789061771.369060:0:7451:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1789061771.369107:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006964ea87 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875967130739456:0@lo:700: 00000100:00100000:1.0:1789061771.369153:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061771.369193:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab01ce3d going to sleep for 11 seconds 00080000:10000000:0.0:1789061771.369230:0:7425:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:3.0:1789061771.369251:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130739456 00000100:00100000:3.0:1789061771.369256:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130739456 00000100:00100000:3.0:1789061771.369296:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061771.369303:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e6928afd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7451:x1875967130739456:12345-0@lo:700: 00000100:00100000:3.0:1789061771.369358:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e6928afd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7451:x1875967130739456:12345-0@lo:700: Request processed in 55us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.369364:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789061771.369978:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006964ea87 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875967130739456:0@lo:700: 00000100:00100000:1.0:1789061771.370020:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006964ea87 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7451:1875967130739584:0@lo:900: 00100000:10000000:0.0:1789061771.370053:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000100:00100000:1.0:1789061771.370062:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061771.370091:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab01ce3d going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.370141:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130739584 00000100:00100000:3.0:1789061771.370146:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130739584 00000100:00100000:3.0:1789061771.370178:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789061771.370185:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b0f75e0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7451:x1875967130739584:12345-0@lo:900: 00000100:00100000:3.0:1789061771.370234:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b0f75e0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7451:x1875967130739584:12345-0@lo:900: Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.370241:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789061771.370309:0:7451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006964ea87 x1875967130739584/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789061787 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061771.370321:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006964ea87 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7451:1875967130739584:0@lo:900: 00000100:00100000:2.0:1789061771.370391:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ccc73e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875967130739712:0@lo:1000: 00000100:00100000:2.0:1789061771.370428:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061771.370450:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000001366df23 going to sleep for 11 seconds 00100000:10000000:0.0:1789061771.370540:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000100:00100000:3.0:1789061771.370676:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130739712 00000100:00100000:3.0:1789061771.370681:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130739712 00100000:10000000:0.0:1789061771.370710:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000100:00100000:3.0:1789061771.370713:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061771.370718:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3b0cbb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1875967130739712:12345-0@lo:1000: 00000100:00100000:3.0:1789061771.370777:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3b0cbb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1875967130739712:12345-0@lo:1000: Request processed in 59us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.370784:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789061771.370967:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ccc73e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875967130739712:0@lo:1000: 00000004:00080000:2.0:1789061771.371003:0:7451:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000009029eb3d with version 0 00000020:00100000:2.0:1789061771.371016:0:7451:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789061771.371020:0:7451:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000008ccc73e0 x1875967130739968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789061771.371041:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ccc73e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875967130739968:0@lo:1000: 00000100:00100000:2.0:1789061771.371073:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061771.371095:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 0000000065168332 going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.371132:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130739968 00000100:00100000:3.0:1789061771.371137:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130739968 00000100:00100000:3.0:1789061771.371165:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789061771.371170:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cee0f43b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1875967130739968:12345-0@lo:1000: 00100000:10000000:0.0:1789061771.371250:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789061771.371490:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789061771.371775:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789061771.371983:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 40000000:02000000:1.0:1789061771.372135:0:6503:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:0.0:1789061771.372281:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789061771.372508:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789061771.372672:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789061771.372875:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789061771.373011:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789061771.373305:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789061771.373509:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789061771.373664:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789061771.373900:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789061771.374446:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789061771.374586:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789061771.374748:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789061771.375321:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789061771.375531:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789061771.375704:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789061771.375931:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789061771.376626:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789061771.376842:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789061771.376976:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789061771.379570:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789061771.379788:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789061771.379943:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789061771.380105:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789061771.380266:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789061771.380437:0:7425:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789061771.380661:0:7425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789061771.384853:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000876c21bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7450:x1875967130739200:12345-0@lo:700: Request processed in 21729us (21999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.384871:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789061771.385201:0:7450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008231d083 x1875967130739200/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789061787 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061771.385215:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008231d083 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7450:1875967130739200:0@lo:700: 40000000:02000000:1.0:1789061771.385227:0:7450:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:3.0:1789061771.386161:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1789061771.386249:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cee0f43b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1875967130739968:12345-0@lo:1000: Request processed in 15078us (15175us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789061771.386258:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1789061771.386360:0:7451:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789061771.386375:0:7451:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789061771.386387:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ccc73e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875967130739968:0@lo:1000: 00000100:00100000:2.0:1789061771.386472:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ccc73e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875967130740096:0@lo:1000: 00000100:00100000:2.0:1789061771.386507:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061771.386548:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000000567f0a4 going to sleep for 11 seconds 00000100:00100000:3.0:1789061771.386600:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130740096 00000100:00100000:3.0:1789061771.386647:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130740096 00000100:00100000:3.0:1789061771.386682:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789061771.386688:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007905f97f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7451:x1875967130740096:12345-0@lo:1000: 00000100:00100000:3.0:1789061771.386756:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007905f97f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7451:x1875967130740096:12345-0@lo:1000: Request processed in 68us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061771.386762:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789061771.386884:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ccc73e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1875967130740096:0@lo:1000: 00000040:00080000:2.0:1789061771.386900:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789061771.386925:0:7451:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000009029eb3d with version 1 00000004:00080000:0.0:1789061771.387024:0:7441:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000006c8928d2 version 1 rpc_version 1 00000020:00100000:0.0:1789061771.387051:0:7441:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789061771.387056:0:7441:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003874fab2 x1875967130740352/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789061771.387070:0:7441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003874fab2 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7441:1875967130740352:0@lo:1000: 00000100:00100000:0.0:1789061771.387103:0:7441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061771.387123:0:7441:0:(client.c:2716:ptlrpc_set_wait()) set 00000000692d833c going to sleep for 11 seconds 00000100:00100000:0.0:1789061771.387164:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130740352 00000100:00100000:0.0:1789061771.387168:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130740352 00000100:00100000:0.0:1789061771.387188:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789061771.387193:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000699a11ba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7441:x1875967130740352:12345-0@lo:1000: 00000001:00080000:0.0:1789061771.387759:0:7425:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789061771.387786:0:7425:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbc884193f988 00100000:10000000:0.0:1789061771.387792:0:7425:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:2.0:1789061771.389015:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789061771.389086:0:7451:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000020:01000004:0.0:1789061771.390042:0:7425:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789061771.390071:0:7425:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789061771.390090:0:7425:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789061771.390108:0:7425:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789061771.392498:0:7425:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789061771.392704:0:7425:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:1.0:1789061771.398965:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1789061771.399104:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000699a11ba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7441:x1875967130740352:12345-0@lo:1000: Request processed in 11907us (11997us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789061771.399115:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1789061771.399265:0:7441:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789061771.399270:0:7441:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789061771.399287:0:7441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003874fab2 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7441:1875967130740352:0@lo:1000: 00000040:00080000:1.0:1789061771.434187:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061771.448538:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789061771.448621:0:7450:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789061771.448626:0:7450:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1789061772.074449:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061773.101164:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061774.123293:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061775.146995:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789061775.285187:0:7696:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789061776.169968:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789061776.218313:0:7748:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789061776.220323:0:7748:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789061776.553907:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c345fbba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130740608:0@lo:400: 00000100:00100000:2.0:1789061776.553978:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061776.554014:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008231d083 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130740480:0@lo:400: 00000100:00100000:1.0:1789061776.554058:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061776.554115:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000663a3aaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130740864:0@lo:400: 00000100:00100000:1.0:1789061776.554150:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061776.554161:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130740608 00000100:00100000:0.0:1789061776.554166:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130740480 00000100:00100000:3.0:1789061776.554170:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130740608 00000100:00100000:1.0:1789061776.554170:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061776.554172:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130740480 00000100:00100000:1.0:1789061776.554176:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e05e59b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130740736:0@lo:400: 00000100:00100000:1.0:1789061776.554203:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061776.554229:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789061776.554231:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130740864 00000100:00100000:3.0:1789061776.554236:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130740864 00000100:00100000:0.0:1789061776.554240:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fbff341b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:3622:x1875967130740480:12345-0@lo:400: 00000100:00100000:1.0:1789061776.554260:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130740736 00000100:00100000:3.0:1789061776.554261:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789061776.554266:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130740736 00000100:00100000:3.0:1789061776.554286:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008ccc73e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130740608:12345-0@lo:400: 00000100:00100000:1.0:1789061776.554303:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061776.554308:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fbff341b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:3622:x1875967130740480:12345-0@lo:400: Request processed in 73us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061776.554310:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091e0178b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130740736:12345-0@lo:400: 00000100:00100000:0.0:1789061776.554316:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789061776.554322:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e36b8bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130740992:0@lo:41: 00000100:00100000:3.0:1789061776.554337:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008ccc73e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130740608:12345-0@lo:400: Request processed in 66us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061776.554355:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061776.554382:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789061776.554390:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091e0178b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130740736:12345-0@lo:400: Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061776.554394:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006964ea87 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130740864:12345-0@lo:400: 00000100:00100000:2.0:1789061776.554403:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061776.554404:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061776.554416:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e05e59b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130740736:0@lo:400: 00000100:00100000:1.0:1789061776.554423:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130740992 00000100:00100000:1.0:1789061776.554425:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130740992 00000100:00100000:1.0:1789061776.554453:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789061776.554458:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006964ea87 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130740864:12345-0@lo:400: Request processed in 68us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061776.554459:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008231d083 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130740480:0@lo:400: 00000100:00100000:1.0:1789061776.554462:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d587983c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130740992:12345-0@lo:41: 00000100:00100000:3.0:1789061776.554476:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789061776.554491:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000663a3aaf x1875967130740864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:00000024:1.0:1789061776.554493:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789061776.554501:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000663a3aaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130740864:0@lo:400: 00000100:00100000:1.0:1789061776.554534:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d587983c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130740992:12345-0@lo:41: Request processed in 74us (139us total) trans 0 rc 0/0 00010000:00080000:2.0:1789061776.554537:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c345fbba x1875967130740608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061776.554544:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789061776.554550:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e36b8bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130740992:0@lo:41: 00000100:00100000:2.0:1789061776.554556:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c345fbba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130740608:0@lo:400: 00010000:00010000:0.0:1789061777.193843:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061778.218730:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789061778.959029:0:7849:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789061778.959210:0:7849:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1789061779.122530:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789061779.122537:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767fb057800 from 4 10000000:01000000:1.0:1789061779.122540:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789061779.122582:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000e778028a/0x2774d8f311dc6433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.122594:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000e778028a/0x2774d8f311dc6433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.122604:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000e778028a/0x2774d8f311dc6433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061779.122645:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130741120:0@lo:101: 00000100:00100000:1.0:1789061779.122704:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061779.122745:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fb937b6 going to sleep for 11 seconds 00000100:00100000:1.0:1789061779.122765:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130741120 00000100:00100000:1.0:1789061779.122772:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130741120 00000100:00100000:1.0:1789061779.122814:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789061779.122821:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000094ccdc3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:6493:x1875967130741120:12345-0@lo:101: 00010000:00010000:1.0:1789061779.122833:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061779.122844:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a903c18e/0x2774d8f311dc643a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6433 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.122865:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a903c18e/0x2774d8f311dc643a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6433 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.122876:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a903c18e/0x2774d8f311dc643a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6433 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.122898:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a903c18e, rc 0) 00000100:00100000:1.0:1789061779.122931:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000094ccdc3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:6493:x1875967130741120:12345-0@lo:101: Request processed in 110us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061779.122937:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789061779.122993:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130741120:0@lo:101: 00010000:00010000:1.0:1789061779.123006:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000e778028a/0x2774d8f311dc6433 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc643a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.123014:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000e778028a/0x2774d8f311dc6433 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc643a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061779.123057:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130741248:0@lo:256: 00000100:00100000:1.0:1789061779.123085:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061779.123100:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fb937b6 going to sleep for 11 seconds 00000100:00100000:1.0:1789061779.123112:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130741248 00000100:00100000:1.0:1789061779.123116:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130741248 00000100:00100000:1.0:1789061779.123135:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789061779.123140:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076478a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:6493:x1875967130741248:12345-0@lo:256: 20000000:01000000:1.0:1789061779.123152:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789061779.123168:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789061779.123171:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789061779.123239:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076478a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:6493:x1875967130741248:12345-0@lo:256: Request processed in 99us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061779.123247:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789061779.123275:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130741248:0@lo:256: 10000000:01000000:1.0:1789061779.123309:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789061779.123318:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000e778028a/0x2774d8f311dc6433 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc643a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.123325:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000e778028a/0x2774d8f311dc6433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc643a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061779.123333:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789061779.123335:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767c3163000 from 21 10000000:01000000:1.0:1789061779.123337:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789061779.123500:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000005abb0a99/0x2774d8f311dc6441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.123508:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000005abb0a99/0x2774d8f311dc6441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.123515:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000005abb0a99/0x2774d8f311dc6441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061779.123528:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130741376:0@lo:101: 00000100:00100000:1.0:1789061779.123552:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061779.123565:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fb937b6 going to sleep for 11 seconds 00000100:00100000:1.0:1789061779.123577:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130741376 00000100:00100000:1.0:1789061779.123580:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130741376 00000100:00100000:1.0:1789061779.123602:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789061779.123628:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004f37c6f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:6493:x1875967130741376:12345-0@lo:101: 00010000:00010000:1.0:1789061779.123636:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061779.123643:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6441 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.123656:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6441 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.123671:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002bbe3e76/0x2774d8f311dc6448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6441 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.123677:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002bbe3e76, rc 0) 00000100:00100000:1.0:1789061779.123705:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004f37c6f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130741376:12345-0@lo:101: Request processed in 79us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061779.123711:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789061779.123741:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130741376:0@lo:101: 00010000:00010000:1.0:1789061779.123751:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000005abb0a99/0x2774d8f311dc6441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6448 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.123758:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000005abb0a99/0x2774d8f311dc6441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6448 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061779.123804:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130741504:0@lo:501: 00000100:00100000:1.0:1789061779.123826:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061779.123838:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fb937b6 going to sleep for 11 seconds 00000100:00100000:1.0:1789061779.123850:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130741504 00000100:00100000:1.0:1789061779.123853:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130741504 00000100:00100000:1.0:1789061779.123871:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789061779.123876:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a554f4b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130741504:12345-0@lo:501: 00000100:00100000:1.0:1789061779.123990:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a554f4b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130741504:12345-0@lo:501: Request processed in 114us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061779.123997:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789061779.124029:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130741504:0@lo:501: 00000100:00100000:1.0:1789061779.124051:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130741632:0@lo:503: 00000100:00100000:1.0:1789061779.124092:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061779.124104:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fb937b6 going to sleep for 11 seconds 00000100:00100000:1.0:1789061779.124115:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130741632 00000100:00100000:1.0:1789061779.124119:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130741632 00000100:00100000:1.0:1789061779.124138:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789061779.124143:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002694e38d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130741632:12345-0@lo:503: 00000100:00100000:1.0:1789061779.124227:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002694e38d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130741632:12345-0@lo:503: Request processed in 83us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061779.124233:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789061779.124271:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130741632:0@lo:503: 00000100:00100000:1.0:1789061779.126664:0:7861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7861:1875967130741760:0@lo:502: 00000100:00100000:1.0:1789061779.126736:0:7861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061779.126769:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130741760 00000100:00100000:1.0:1789061779.126774:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130741760 00000100:00100000:1.0:1789061779.126809:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789061779.126816:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ae86f34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7861:x1875967130741760:12345-0@lo:502: 00000100:00100000:1.0:1789061779.126916:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ae86f34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7861:x1875967130741760:12345-0@lo:502: Request processed in 101us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061779.126924:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789061779.126969:0:7861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee3f9e7c going to sleep for 11 seconds 00000100:00100000:1.0:1789061779.126998:0:7861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7861:1875967130741760:0@lo:502: 00000100:00100000:1.0:1789061779.127039:0:7861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7861:1875967130741888:0@lo:502: 00000100:00100000:1.0:1789061779.127068:0:7861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061779.127087:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130741888 00000100:00100000:1.0:1789061779.127090:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130741888 00000100:00100000:1.0:1789061779.127111:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789061779.127124:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003aeb0aeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7861:x1875967130741888:12345-0@lo:502: 00000100:00100000:1.0:1789061779.127180:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003aeb0aeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:7861:x1875967130741888:12345-0@lo:502: Request processed in 57us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061779.127186:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789061779.127211:0:7861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee3f9e7c going to sleep for 11 seconds 00000100:00100000:1.0:1789061779.127223:0:7861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7861:1875967130741888:0@lo:502: 00000040:00080000:1.0:1789061779.127238:0:7861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789061779.127284:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789061779.127300:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789061779.127308:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000005abb0a99/0x2774d8f311dc6441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6448 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.127318:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000005abb0a99/0x2774d8f311dc6441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6448 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061779.127326:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789061779.127329:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767c3163000 from 4 10000000:01000000:1.0:1789061779.127332:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789061779.127545:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000006c0cde8a/0x2774d8f311dc644f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.127553:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000006c0cde8a/0x2774d8f311dc644f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.127561:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000006c0cde8a/0x2774d8f311dc644f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061779.127573:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130742016:0@lo:101: 00000100:00100000:1.0:1789061779.127599:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061779.127649:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c966bcb5 going to sleep for 11 seconds 00000100:00100000:0.0:1789061779.129456:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130742016 00000100:00100000:0.0:1789061779.129469:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130742016 00000100:00100000:0.0:1789061779.129518:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789061779.129527:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000536c5a63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130742016:12345-0@lo:101: 00010000:00010000:0.0:1789061779.129541:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061779.129555:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052b09865/0x2774d8f311dc6456 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc644f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.129578:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052b09865/0x2774d8f311dc6456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc644f expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.129596:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052b09865/0x2774d8f311dc6456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc644f expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.129630:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052b09865, rc 0) 00000100:00100000:0.0:1789061779.129690:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000536c5a63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130742016:12345-0@lo:101: Request processed in 165us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061779.129696:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789061779.130737:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130742016:0@lo:101: 00010000:00010000:1.0:1789061779.130757:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000006c0cde8a/0x2774d8f311dc644f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6456 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.130767:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000006c0cde8a/0x2774d8f311dc644f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6456 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061779.130828:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130742144:0@lo:256: 00000100:00100000:1.0:1789061779.130876:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061779.130910:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c966bcb5 going to sleep for 11 seconds 00000100:00100000:3.0:1789061779.131148:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130742144 00000100:00100000:3.0:1789061779.131155:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130742144 00000100:00100000:3.0:1789061779.131196:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789061779.131203:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e79d6c1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130742144:12345-0@lo:256: 20000000:01000000:3.0:1789061779.131219:0:6488:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789061779.131235:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789061779.131238:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789061779.131323:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e79d6c1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130742144:12345-0@lo:256: Request processed in 121us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.131330:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789061779.131557:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130742144:0@lo:256: 10000000:01000000:1.0:1789061779.131652:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789061779.131659:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000006c0cde8a/0x2774d8f311dc644f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6456 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.131667:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000006c0cde8a/0x2774d8f311dc644f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6456 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061779.131675:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789061779.131678:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789061779.131680:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789061779.131700:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 000000009f1eaa26/0x2774d8f311dc645d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.131706:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 000000009f1eaa26/0x2774d8f311dc645d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.131714:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 000000009f1eaa26/0x2774d8f311dc645d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061779.131730:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130742272:0@lo:101: 00000100:00100000:1.0:1789061779.131754:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061779.131774:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c966bcb5 going to sleep for 11 seconds 00000100:00100000:3.0:1789061779.131852:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130742272 00000100:00100000:3.0:1789061779.131857:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130742272 00000100:00100000:3.0:1789061779.131886:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789061779.131892:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009b6ee956 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130742272:12345-0@lo:101: 00010000:00010000:3.0:1789061779.131907:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061779.131917:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000070b0d2f8/0x2774d8f311dc6464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc645d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.131933:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000070b0d2f8/0x2774d8f311dc6464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc645d expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.131942:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000070b0d2f8/0x2774d8f311dc6464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc645d expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.131950:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000070b0d2f8, rc 0) 00000100:00100000:3.0:1789061779.131989:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009b6ee956 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130742272:12345-0@lo:101: Request processed in 98us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.131995:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789061779.132053:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130742272:0@lo:101: 00010000:00010000:0.0:1789061779.132062:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 000000009f1eaa26/0x2774d8f311dc645d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6464 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.132068:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 000000009f1eaa26/0x2774d8f311dc645d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6464 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061779.132113:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003874fab2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130742400:0@lo:501: 00000100:00100000:0.0:1789061779.132134:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061779.132153:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060692e3e going to sleep for 11 seconds 00000100:00100000:3.0:1789061779.132190:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130742400 00000100:00100000:3.0:1789061779.132194:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130742400 00000100:00100000:3.0:1789061779.132218:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789061779.132223:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f498560c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130742400:12345-0@lo:501: 00000100:00100000:3.0:1789061779.132317:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f498560c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130742400:12345-0@lo:501: Request processed in 93us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.132322:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789061779.132440:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003874fab2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130742400:0@lo:501: 00000100:00100000:0.0:1789061779.132465:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003874fab2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130742528:0@lo:503: 00000100:00100000:0.0:1789061779.132497:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061779.132513:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060692e3e going to sleep for 11 seconds 00000100:00100000:3.0:1789061779.132555:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130742528 00000100:00100000:3.0:1789061779.132558:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130742528 00000100:00100000:3.0:1789061779.132628:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789061779.132634:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bad6f310 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130742528:12345-0@lo:503: 00000100:00100000:3.0:1789061779.132695:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bad6f310 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130742528:12345-0@lo:503: Request processed in 62us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.132701:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789061779.133670:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003874fab2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130742528:0@lo:503: 00000100:00100000:3.0:1789061779.134177:0:7862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000916322c5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7862:1875967130742656:0@lo:502: 00000100:00100000:3.0:1789061779.134226:0:7862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061779.134293:0:7862:0:(client.c:2716:ptlrpc_set_wait()) set 00000000102a06c2 going to sleep for 11 seconds 00000100:00100000:0.0:1789061779.134324:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130742656 00000100:00100000:0.0:1789061779.134330:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130742656 00000100:00100000:0.0:1789061779.134449:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789061779.134458:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c82653fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:7862:x1875967130742656:12345-0@lo:502: 00000100:00100000:0.0:1789061779.134591:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c82653fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:7862:x1875967130742656:12345-0@lo:502: Request processed in 135us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061779.134629:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789061779.134731:0:7862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000916322c5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7862:1875967130742656:0@lo:502: 00000020:01000000:1.0:1789061779.134753:0:7862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061779.134763:0:7862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061779.134765:0:7862:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789061779.134769:0:7862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789061779.134773:0:7862:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:1.0:1789061779.134794:0:7862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789061779.134806:0:7862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000041b308a8) 00000020:00000080:1.0:1789061779.134823:0:7862:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1789061779.134828:0:7862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789061779.134893:0:7862:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789061779.134898:0:7862:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789061779.134904:0:7862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc6472 00010000:00080000:1.0:1789061779.134929:0:7862:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003e04b34e@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1789061779.137265:0:7862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1789061779.138206:0:7862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789061779.138219:0:7862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789061779.138250:0:7862:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789061779.138269:0:7862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc6479 00000100:00080000:1.0:1789061779.138279:0:7862:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789061779.138288:0:7862:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000003e04b34e using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789061779.138321:0:7862:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003429f344 x1875967130742784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789061779.138434:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003429f344 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130742784:0@lo:38: 00000100:00100000:0.0:1789061779.138498:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789061779.138640:0:7862:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1789061779.138684:0:7862:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1789061779.138832:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061779.138843:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fcc8fbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130742912:0@lo:400: 00000100:00100000:3.0:1789061779.138872:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061779.138899:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000660ce0d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130743168:0@lo:400: 00000100:00100000:3.0:1789061779.138934:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061779.138956:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061779.138961:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000feee0dde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130743040:0@lo:400: 00000100:00100000:3.0:1789061779.138992:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061779.142726:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130742912 00000100:00100000:3.0:1789061779.142740:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130742912 00000100:00100000:3.0:1789061779.142784:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130743168 00000100:00100000:3.0:1789061779.142787:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130743168 00000100:00100000:3.0:1789061779.142808:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789061779.142815:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e302155d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130742912:12345-0@lo:400: 00000100:00100000:3.0:1789061779.142886:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e302155d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130742912:12345-0@lo:400: Request processed in 71us (4013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.142892:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789061779.142909:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789061779.142914:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000916322c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130743168:12345-0@lo:400: 00000100:00100000:3.0:1789061779.142945:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000916322c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130743168:12345-0@lo:400: Request processed in 32us (4011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.142951:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789061779.143004:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004fcc8fbd x1875967130742912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061779.143035:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fcc8fbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130742912:0@lo:400: 00010000:00080000:3.0:1789061779.143069:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000660ce0d1 x1875967130743168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061779.143077:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000660ce0d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130743168:0@lo:400: 00000100:00100000:2.0:1789061779.143208:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130742784 00000100:00100000:2.0:1789061779.143214:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130742784 00000100:00100000:2.0:1789061779.143229:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130743040 00000100:00100000:2.0:1789061779.143232:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130743040 00000100:00100000:2.0:1789061779.143248:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789061779.143252:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c92bf9dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875967130742784:12345-0@lo:38: 00010000:00080000:2.0:1789061779.143274:0:6501:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:2.0:1789061779.143309:0:6501:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc6480 00000004:00100000:2.0:1789061779.143323:0:6501:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789061779.143328:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789061779.144226:0:7865:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000e7a363ba x1875967130743296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061779.144237:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c3f456b going to sleep for 0 seconds 00000020:01000000:3.0:1789061779.144503:0:7862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061779.144510:0:7862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061779.144513:0:7862:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789061779.144516:0:7862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061779.144519:0:7862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061779.144521:0:7862:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789061779.144524:0:7862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789061779.144526:0:7862:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789061779.144548:0:7862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000660ce0d1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7862:1875967130743424:0@lo:502: 00000100:00100000:3.0:1789061779.144638:0:7862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061779.144669:0:7862:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b25a2bac going to sleep for 11 seconds 00000100:00100000:1.0:1789061779.144731:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130743424 00000100:00100000:1.0:1789061779.144737:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130743424 00000100:00100000:1.0:1789061779.144772:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789061779.144778:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b1fb59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:7862:x1875967130743424:12345-0@lo:502: 00000100:00100000:1.0:1789061779.144872:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b1fb59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:7862:x1875967130743424:12345-0@lo:502: Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061779.144879:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789061779.144988:0:7862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000660ce0d1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:7862:1875967130743424:0@lo:502: 00000020:01000000:2.0:1789061779.145012:0:7862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061779.145016:0:7862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061779.145017:0:7862:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789061779.145022:0:7862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789061779.145144:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789061779.145163:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789061779.145170:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 000000009f1eaa26/0x2774d8f311dc645d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6464 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.145180:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 000000009f1eaa26/0x2774d8f311dc645d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6464 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061779.145189:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789061779.145191:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9767f38a8000 from 1 10000000:01000000:3.0:1789061779.145194:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789061779.145213:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000b740af74/0x2774d8f311dc6487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.145230:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000b740af74/0x2774d8f311dc6487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.145237:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000b740af74/0x2774d8f311dc6487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061779.145248:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fcc8fbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130743552:0@lo:101: 00000100:00100000:3.0:1789061779.145270:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061779.145295:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c2d5d189 going to sleep for 11 seconds 00000100:00100000:1.0:1789061779.145330:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130743552 00000100:00100000:1.0:1789061779.145334:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130743552 00000100:00100000:1.0:1789061779.145438:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789061779.145445:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ad548be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130743552:12345-0@lo:101: 00010000:00010000:1.0:1789061779.145452:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061779.145462:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f26bcae/0x2774d8f311dc648e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6487 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.145479:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f26bcae/0x2774d8f311dc648e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6487 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.145487:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f26bcae/0x2774d8f311dc648e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6487 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.145495:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f26bcae, rc 0) 00000100:00100000:1.0:1789061779.145526:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ad548be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130743552:12345-0@lo:101: Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061779.145532:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789061779.145653:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fcc8fbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130743552:0@lo:101: 00010000:00010000:2.0:1789061779.145663:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000b740af74/0x2774d8f311dc6487 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc648e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061779.145670:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000b740af74/0x2774d8f311dc6487 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc648e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061779.145712:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086e23aed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130743680:0@lo:501: 00000100:00100000:2.0:1789061779.145734:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061779.145966:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c38f8b99 going to sleep for 11 seconds 00000100:00100000:3.0:1789061779.146022:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130743680 00000100:00100000:3.0:1789061779.146026:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130743680 00000100:00100000:3.0:1789061779.146044:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789061779.146048:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d80f9ada pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130743680:12345-0@lo:501: 00000100:00100000:3.0:1789061779.146129:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d80f9ada pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130743680:12345-0@lo:501: Request processed in 81us (394us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789061779.146135:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789061779.146222:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086e23aed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130743680:0@lo:501: 10000000:01000000:2.0:1789061779.146248:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789061779.146252:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: 00000000b740af74/0x2774d8f311dc6487 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc648e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061779.146258:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: 00000000b740af74/0x2774d8f311dc6487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc648e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789061779.155112:0:6501:0:(import.c:65:import_set_state_nolock()) 000000004337d375 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061779.155258:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c92bf9dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875967130742784:12345-0@lo:38: Request processed in 12003us (16759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.155268:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789061779.155294:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789061779.155435:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789061779.155444:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789061779.155451:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789061779.155456:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789061779.155458:0:3619:0:(import.c:65:import_set_state_nolock()) 000000003e04b34e lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789061779.155521:0:3619:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006c3f456b): req@00000000e7a363ba x1875967130743296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061779.155600:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000099efe1ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130743040:12345-0@lo:400: 00000100:00100000:3.0:1789061779.155664:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000099efe1ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130743040:12345-0@lo:400: Request processed in 69us (16671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.155670:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789061779.155700:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000feee0dde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130743040:0@lo:400: 00000100:00100000:2.0:1789061779.155858:0:7865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061779.155895:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c3f456b going to sleep for 11 seconds 00000100:00100000:3.0:1789061779.155933:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130743296 00000100:00100000:3.0:1789061779.155940:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130743296 00000100:00100000:3.0:1789061779.155988:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789061779.155995:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000086e23aed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7865:x1875967130743296:12345-0@lo:1000: 00000100:00100000:3.0:1789061779.156055:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000086e23aed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7865:x1875967130743296:12345-0@lo:1000: Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.156062:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789061779.156125:0:7865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7a363ba pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7865:1875967130743296:0@lo:1000: 00000040:01000000:2.0:1789061779.156154:0:7865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789061779.156188:0:7865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8611a58 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7865:1875967130743808:0@lo:1000: 00000100:00100000:2.0:1789061779.156215:0:7865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061779.156236:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c66069ab going to sleep for 11 seconds 00000100:00100000:3.0:1789061779.156271:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130743808 00000100:00100000:3.0:1789061779.156276:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130743808 00000100:00100000:3.0:1789061779.156309:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789061779.156315:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ee3275c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7865:x1875967130743808:12345-0@lo:1000: 00000100:00100000:3.0:1789061779.156414:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ee3275c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7865:x1875967130743808:12345-0@lo:1000: Request processed in 100us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.156421:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789061779.156526:0:7865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8611a58 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7865:1875967130743808:0@lo:1000: 00000100:00100000:2.0:1789061779.156563:0:7865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8611a58 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7865:1875967130743936:0@lo:700: 00000100:00100000:2.0:1789061779.156586:0:7865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061779.156634:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c38f8b99 going to sleep for 11 seconds 00000100:00100000:3.0:1789061779.156691:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130743936 00000100:00100000:3.0:1789061779.156696:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130743936 00000100:00100000:3.0:1789061779.156730:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061779.156736:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e36b8bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7865:x1875967130743936:12345-0@lo:700: 00000100:00100000:3.0:1789061779.156776:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e36b8bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7865:x1875967130743936:12345-0@lo:700: Request processed in 41us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.156782:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789061779.156839:0:7865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8611a58 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7865:1875967130743936:0@lo:700: 00000100:00100000:2.0:1789061779.156924:0:7865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8611a58 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7865:1875967130744064:0@lo:1000: 00000100:00100000:2.0:1789061779.156948:0:7865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061779.156970:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set 000000009969859e going to sleep for 11 seconds 00000100:00100000:3.0:1789061779.157137:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130744064 00000100:00100000:3.0:1789061779.157142:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130744064 00000100:00100000:3.0:1789061779.157172:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789061779.157178:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7b5b5c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7865:x1875967130744064:12345-0@lo:1000: 00000100:00100000:3.0:1789061779.157226:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7b5b5c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7865:x1875967130744064:12345-0@lo:1000: Request processed in 48us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.157245:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789061779.157309:0:7865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8611a58 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7865:1875967130744064:0@lo:1000: 00000004:00080000:2.0:1789061779.157347:0:7865:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000c38f8b99 with version 0 00000020:00100000:2.0:1789061779.157649:0:7865:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789061779.157654:0:7865:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d8611a58 x1875967130744320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789061779.157673:0:7865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8611a58 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7865:1875967130744320:0@lo:1000: 00000100:00100000:2.0:1789061779.157696:0:7865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061779.157711:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041efde2b going to sleep for 11 seconds 00000100:00100000:3.0:1789061779.157789:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130744320 00000100:00100000:3.0:1789061779.157793:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130744320 00000100:00100000:3.0:1789061779.157819:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789061779.157825:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000674d69c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7865:x1875967130744320:12345-0@lo:1000: 00000100:00100000:0.0:1789061779.158183:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003429f344 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130742784:0@lo:38: 00000100:00100000:3.0:1789061779.158419:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130744448:0@lo:41: 00000100:00100000:3.0:1789061779.158453:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061779.158578:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789061779.158587:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789061779.158845:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130744448 00000100:00100000:2.0:1789061779.158850:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130744448 00000100:00100000:1.0:1789061779.158991:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789061779.158998:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000feee0dde pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3622:x1875967130744448:12345-0@lo:41: 00000004:00000024:1.0:1789061779.159018:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789061779.159089:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000feee0dde pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3622:x1875967130744448:12345-0@lo:41: Request processed in 93us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061779.159096:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789061779.159142:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff125f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130744448:0@lo:41: 00000001:00080000:1.0:1789061779.170157:0:7427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1789061779.170171:0:7427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789061779.170565:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000674d69c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7865:x1875967130744320:12345-0@lo:1000: Request processed in 12736us (12865us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789061779.170577:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1789061779.170887:0:7865:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789061779.170892:0:7865:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789061779.170907:0:7865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8611a58 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7865:1875967130744320:0@lo:1000: 00000100:00100000:2.0:1789061779.171011:0:7865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8611a58 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7865:1875967130744576:0@lo:1000: 00000100:00100000:2.0:1789061779.171050:0:7865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061779.171120:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c66069ab going to sleep for 11 seconds 00000100:00100000:3.0:1789061779.171156:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130744576 00000100:00100000:3.0:1789061779.171163:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130744576 00000100:00100000:3.0:1789061779.171240:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789061779.171249:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016738007 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7865:x1875967130744576:12345-0@lo:1000: 00000100:00100000:3.0:1789061779.171375:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016738007 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7865:x1875967130744576:12345-0@lo:1000: Request processed in 128us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.171381:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789061779.171719:0:7865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8611a58 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7865:1875967130744576:0@lo:1000: 00000040:00080000:2.0:1789061779.171738:0:7865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789061779.171770:0:7865:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000c38f8b99 with version 1 00000004:00080000:0.0:1789061779.172647:0:7863:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000078610798 version 1 rpc_version 1 00000020:00100000:0.0:1789061779.172675:0:7863:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789061779.172683:0:7863:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e6eea551 x1875967130744832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789061779.172699:0:7863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e6eea551 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7863:1875967130744832:0@lo:1000: 00000100:00100000:0.0:1789061779.172749:0:7863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061779.172793:0:7863:0:(client.c:2716:ptlrpc_set_wait()) set 000000000eee89d8 going to sleep for 11 seconds 00000100:00100000:1.0:1789061779.173453:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130744832 00000100:00100000:1.0:1789061779.173462:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130744832 00000100:00100000:1.0:1789061779.173515:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789061779.173522:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e101b9e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7863:x1875967130744832:12345-0@lo:1000: 00000001:00080000:1.0:1789061779.177685:0:7427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1789061779.177809:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e101b9e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7863:x1875967130744832:12345-0@lo:1000: Request processed in 4284us (5057us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789061779.177821:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1789061779.178077:0:7863:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789061779.178082:0:7863:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789061779.178098:0:7863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e6eea551 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7863:1875967130744832:0@lo:1000: 00000040:00080000:2.0:1789061779.178533:0:7865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789061779.178670:0:7865:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789061779.178675:0:7865:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789061779.243445:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789061779.886759:0:7903:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe975e4da0 20000000:00000080:1.0:1789061779.886778:0:7903:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9767fb122000 uarg=0000000000000000 20000000:01000000:1.0:1789061779.886884:0:7903:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789061779.886891:0:7903:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789061779.886896:0:7903:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789061779.887038:0:7903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789061779.887050:0:7903:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789061779.894099:0:7903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789061779.894791:0:7903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789061779.894823:0:7903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1789061779.894837:0:7903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1789061779.894855:0:7903:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789061779.894885:0:7903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.894911:0:7903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a707b56a/0x2774d8f311dc6314 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc630d expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.894918:0:7903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b348ff84/0x2774d8f311dc6402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc63fb expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.894934:0:7903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.894985:0:7903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b348ff84/0x2774d8f311dc6402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc63fb expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.894999:0:7903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b348ff84/0x2774d8f311dc6402 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc63fb expref: 17 pid: 6490 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061779.895017:0:7903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c345fbba pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7903:1875967130744960:0@lo:104: 00000100:00100000:1.0:1789061779.895080:0:7903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789061779.895144:0:7903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a707b56a/0x2774d8f311dc6314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc630d expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.895153:0:7903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a707b56a/0x2774d8f311dc6314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc630d expref: 17 pid: 6491 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061779.895161:0:7903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000663a3aaf pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7903:1875967130745088:0@lo:104: 00000100:00100000:1.0:1789061779.895179:0:7903:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0874299 going to sleep for 11 seconds 00000100:00100000:0.0:1789061779.895258:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789061779.895277:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061779.895298:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130744960 00000100:00100000:0.0:1789061779.895311:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130744960 00000100:00100000:0.0:1789061779.895356:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130745088 00000100:00100000:0.0:1789061779.895359:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130745088 00000100:00100000:0.0:1789061779.895383:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789061779.895391:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d18c7003 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:7903:x1875967130744960:12345-0@lo:104: 00010000:00010000:0.0:1789061779.895402:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6402 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.895451:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789061779.895456:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d18c7003 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:7903:x1875967130744960:12345-0@lo:104: Request processed in 67us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061779.895463:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789061779.895524:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061779.895532:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e6eea551 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:7903:x1875967130745088:12345-0@lo:104: 00010000:00010000:0.0:1789061779.895539:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6314 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061779.895957:0:7903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c345fbba pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7903:1875967130744960:0@lo:104: 00010000:00010000:3.0:1789061779.896148:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061779.896154:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6402 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.896163:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b21bdae0 already unused, calling callback (000000006ac241b9) 10000000:00010000:3.0:1789061779.896166:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6402 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.896174:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6402 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061779.896187:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6402 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061779.896194:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789061779.897046:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789061779.897055:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e6eea551 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:7903:x1875967130745088:12345-0@lo:104: Request processed in 1524us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061779.897065:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789061779.897077:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6402 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.897087:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061779.897090:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061779.897109:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6402 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.897117:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 00000000b21bdae0/0x2774d8f311dc63fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6402 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.897128:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061779.897130:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061779.897132:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061779.897143:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f139b6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130745216:0@lo:103: 00000100:00100000:3.0:1789061779.897177:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061779.897220:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130745216 00000100:00100000:3.0:1789061779.897225:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130745216 00010000:00010000:3.0:1789061779.897428:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b348ff84/0x2774d8f311dc6402 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc63fb expref: 18 pid: 6490 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061779.897458:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789061779.897465:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000973e9353 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:3623:x1875967130745216:12345-0@lo:103: 00010000:00010000:3.0:1789061779.897477:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061779.897481:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b348ff84/0x2774d8f311dc6402 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc63fb expref: 18 pid: 6490 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.897499:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b348ff84/0x2774d8f311dc6402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc63fb expref: 18 pid: 6490 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.897513:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b348ff84/0x2774d8f311dc6402 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc63fb expref: 18 pid: 6490 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061779.897524:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061779.897553:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000973e9353 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:3623:x1875967130745216:12345-0@lo:103: Request processed in 90us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061779.897559:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789061779.897587:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f139b6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130745216:0@lo:103: 00010000:00010000:0.0:1789061779.897689:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061779.897696:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6314 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.897705:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030237e06 already unused, calling callback (000000006ac241b9) 10000000:00010000:0.0:1789061779.897708:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6314 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.897727:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6314 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061779.897732:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6314 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061779.897737:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789061779.897756:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6314 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.897763:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061779.897791:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6314 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061779.897792:0:7903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000663a3aaf pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7903:1875967130745088:0@lo:104: 00010000:00010000:0.0:1789061779.897804:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: 0000000030237e06/0x2774d8f311dc630d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6314 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.897813:0:7903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.897820:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061779.897823:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061779.897826:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061779.897834:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061779.897837:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061779.897843:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f6de8da4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130745344:0@lo:103: 00000100:00100000:1.0:1789061779.897871:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061779.898798:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130745344 00000100:00100000:0.0:1789061779.898806:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130745344 00010000:00010000:0.0:1789061779.898829:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a707b56a/0x2774d8f311dc6314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc630d expref: 17 pid: 6491 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061779.898861:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061779.898868:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000663a3aaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:3620:x1875967130745344:12345-0@lo:103: 00010000:00010000:0.0:1789061779.898888:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061779.898892:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a707b56a/0x2774d8f311dc6314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc630d expref: 17 pid: 6491 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.898902:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a707b56a/0x2774d8f311dc6314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc630d expref: 17 pid: 6491 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.898915:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a707b56a/0x2774d8f311dc6314 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc630d expref: 17 pid: 6491 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.898928:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.898935:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.898958:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.899075:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.899084:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.899090:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.899096:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003e5fa45c already unused, calling callback (00000000c3156870) 00010000:00010000:0.0:1789061779.899099:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.899116:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.899136:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061779.899146:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061779.899194:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000663a3aaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:3620:x1875967130745344:12345-0@lo:103: Request processed in 327us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061779.899201:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789061779.900568:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f6de8da4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130745344:0@lo:103: 00010000:00010000:1.0:1789061779.900599:0:7903:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.900622:0:7903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061779.900629:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e5fa45c/0x2774d8f311dc6495 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061780.265860:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061781.289967:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061781.673877:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061781.673899:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f139b6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130745472:0@lo:41: 00000100:00100000:3.0:1789061781.673981:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061781.674124:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130745472 00000100:00100000:0.0:1789061781.674131:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130745472 00000100:00100000:0.0:1789061781.674173:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789061781.674181:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000065569ddb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130745472:12345-0@lo:41: 00000004:00000024:0.0:1789061781.674210:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789061781.674264:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000065569ddb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130745472:12345-0@lo:41: Request processed in 85us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061781.674272:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789061781.674737:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f139b6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130745472:0@lo:41: 00010000:00010000:0.0:1789061782.313859:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061783.351283:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061784.234856:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc756726 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130745600:0@lo:400: 00000100:00100000:0.0:1789061784.234921:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061784.234979:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130746112:0@lo:400: 00000100:00100000:0.0:1789061784.235003:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061784.235026:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789061784.235031:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000000dd0609 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130745728:0@lo:400: 00000100:00100000:0.0:1789061784.235055:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061784.235097:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f6de8da4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130745856:0@lo:400: 00000100:00100000:0.0:1789061784.235118:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061784.235136:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061784.235140:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003874fab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130745984:0@lo:400: 00000100:00100000:0.0:1789061784.235159:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061784.235187:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130745600 00000100:00100000:0.0:1789061784.235194:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130745600 00000100:00100000:0.0:1789061784.235233:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789061784.235240:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000547fcb14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:3622:x1875967130745600:12345-0@lo:400: 00000100:00100000:0.0:1789061784.235283:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000547fcb14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:3622:x1875967130745600:12345-0@lo:400: Request processed in 44us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061784.235289:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789061784.235317:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130746112 00000100:00100000:0.0:1789061784.235321:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130746112 00000100:00100000:0.0:1789061784.235339:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130745856 00000100:00100000:0.0:1789061784.235342:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130745856 00000100:00100000:0.0:1789061784.235354:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789061784.235359:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de9600a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130746112:12345-0@lo:400: 00000100:00100000:0.0:1789061784.235389:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de9600a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130746112:12345-0@lo:400: Request processed in 31us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061784.235394:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789061784.235404:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789061784.235409:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c9779729 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130745856:12345-0@lo:400: 00000100:00100000:0.0:1789061784.235435:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c9779729 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130745856:12345-0@lo:400: Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061784.235441:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789061784.235455:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130745728 00000100:00100000:0.0:1789061784.235465:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130745728 00000100:00100000:0.0:1789061784.235487:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130745984 00000100:00100000:0.0:1789061784.235490:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130745984 00000100:00100000:0.0:1789061784.235500:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061784.235504:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc8e240e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130745728:12345-0@lo:400: 00000100:00100000:0.0:1789061784.235530:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc8e240e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130745728:12345-0@lo:400: Request processed in 26us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061784.235535:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061784.235545:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789061784.235550:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bbaf5c35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130745984:12345-0@lo:400: 00000100:00100000:0.0:1789061784.235573:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bbaf5c35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130745984:12345-0@lo:400: Request processed in 23us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061784.235578:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789061784.235645:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003874fab2 x1875967130745984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061784.235658:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003874fab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130745984:0@lo:400: 00000100:00100000:0.0:1789061784.235668:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f6de8da4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130745856:0@lo:400: 00010000:00080000:0.0:1789061784.235691:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000000dd0609 x1875967130745728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061784.235699:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000000dd0609 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130745728:0@lo:400: 00000100:00100000:0.0:1789061784.235707:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc756726 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130745600:0@lo:400: 00000100:00100000:0.0:1789061784.235714:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013814478 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130746112:0@lo:400: 00000100:00100000:3.0:1789061784.236015:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c345fbba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130746240:0@lo:41: 00000100:00100000:3.0:1789061784.236046:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061784.236195:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130746240 00000100:00100000:1.0:1789061784.236200:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130746240 00000100:00100000:1.0:1789061784.236232:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789061784.236239:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000f139b6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130746240:12345-0@lo:41: 00000004:00000024:1.0:1789061784.236261:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789061784.236299:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000f139b6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130746240:12345-0@lo:41: Request processed in 61us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061784.236305:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789061784.236338:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c345fbba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130746240:0@lo:41: 00010000:00010000:3.0:1789061784.364044:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061785.391013:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061786.410379:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789061786.793681:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789061786.793689:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fb057800 from 1 10000000:01000000:1.0:1789061786.793695:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789061786.793737:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: 00000000089571b5/0x2774d8f311dc649c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061786.793764:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: 00000000089571b5/0x2774d8f311dc649c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061786.793776:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: 00000000089571b5/0x2774d8f311dc649c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061786.793795:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c345fbba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130746368:0@lo:101: 00000100:00100000:0.0:1789061786.793802:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d15a4cf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130746496:0@lo:41: 00000100:00100000:0.0:1789061786.793872:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061786.793952:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130746496 00000100:00100000:0.0:1789061786.793958:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130746496 00000100:00100000:0.0:1789061786.794002:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789061786.794008:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061786.794013:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000013814478 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130746496:12345-0@lo:41: 00000100:00100000:1.0:1789061786.794035:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000006322482a going to sleep for 11 seconds 00000004:00000024:0.0:1789061786.794045:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789061786.794068:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130746368 00000100:00100000:1.0:1789061786.794073:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130746368 00000100:00100000:0.0:1789061786.794093:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000013814478 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130746496:12345-0@lo:41: Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061786.794101:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789061786.794108:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789061786.794117:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006eb75309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130746368:12345-0@lo:101: 00010000:00010000:1.0:1789061786.794128:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061786.794140:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ba0be641/0x2774d8f311dc64a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc649c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061786.794145:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d15a4cf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130746496:0@lo:41: 00010000:00010000:1.0:1789061786.794231:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba0be641/0x2774d8f311dc64a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc649c expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061786.794243:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ba0be641/0x2774d8f311dc64a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc649c expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061786.794251:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ba0be641, rc 0) 00000100:00100000:1.0:1789061786.794299:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006eb75309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130746368:12345-0@lo:101: Request processed in 185us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061786.794305:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789061786.794407:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c345fbba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130746368:0@lo:101: 00010000:00010000:3.0:1789061786.794420:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: 00000000089571b5/0x2774d8f311dc649c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc64a3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061786.794429:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: 00000000089571b5/0x2774d8f311dc649c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc64a3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061786.794511:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0789635 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130746624:0@lo:501: 00000100:00100000:3.0:1789061786.794538:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061786.794561:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057ab6999 going to sleep for 11 seconds 00000100:00100000:1.0:1789061786.794697:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130746624 00000100:00100000:1.0:1789061786.794705:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130746624 00000100:00100000:1.0:1789061786.794733:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789061786.794738:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000006bfec0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130746624:12345-0@lo:501: 00000100:00100000:1.0:1789061786.794826:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000006bfec0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130746624:12345-0@lo:501: Request processed in 88us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061786.794832:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789061786.794855:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0789635 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130746624:0@lo:501: 00000100:00100000:1.0:1789061786.794877:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008231d083 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130746752:0@lo:503: 00000100:00100000:1.0:1789061786.795066:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061786.795116:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b24e1b5 going to sleep for 11 seconds 00000100:00100000:3.0:1789061786.797027:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130746752 00000100:00100000:3.0:1789061786.797039:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130746752 00000100:00100000:3.0:1789061786.797133:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789061786.797141:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000103dbff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130746752:12345-0@lo:503: 00000100:00100000:3.0:1789061786.797286:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000103dbff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130746752:12345-0@lo:503: Request processed in 146us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061786.797293:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789061786.797371:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008231d083 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130746752:0@lo:503: 00000100:00100000:3.0:1789061786.800915:0:8276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002170d085 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8276:1875967130746880:0@lo:502: 00000100:00100000:3.0:1789061786.801132:0:8276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061786.801176:0:8276:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c30d081 going to sleep for 11 seconds 00000100:00100000:1.0:1789061786.803776:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130746880 00000100:00100000:1.0:1789061786.803787:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130746880 00000100:00100000:1.0:1789061786.803834:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789061786.803841:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb2f9c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:8276:x1875967130746880:12345-0@lo:502: 00000100:00100000:1.0:1789061786.804151:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb2f9c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:8276:x1875967130746880:12345-0@lo:502: Request processed in 310us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061786.804159:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789061786.804251:0:8276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002170d085 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8276:1875967130746880:0@lo:502: 00000020:01000000:3.0:1789061786.804297:0:8276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061786.804305:0:8276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061786.804307:0:8276:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789061786.804314:0:8276:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767fb057800 00000020:00000080:3.0:1789061786.804316:0:8276:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789061786.804361:0:8276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8276:1875967130747008:0@lo:502: 00000100:00100000:3.0:1789061786.804402:0:8276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061786.804436:0:8276:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd526840 going to sleep for 11 seconds 00000100:00100000:1.0:1789061786.804600:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130747008 00000100:00100000:1.0:1789061786.804631:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130747008 00000100:00100000:1.0:1789061786.804656:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789061786.804663:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:8276:x1875967130747008:12345-0@lo:502: 00000100:00100000:1.0:1789061786.804726:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:8276:x1875967130747008:12345-0@lo:502: Request processed in 63us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061786.804732:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789061786.804831:0:8276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8276:1875967130747008:0@lo:502: 00000020:01000000:3.0:1789061786.804849:0:8276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061786.804853:0:8276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061786.804859:0:8276:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789061786.804863:0:8276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789061786.805153:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789061786.805173:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789061786.805183:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47ba00/0x2774d8f311dc649c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc64a3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061786.805198:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767fd47ba00/0x2774d8f311dc649c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc64a3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061786.805208:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789061786.805211:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767c3163000 from 1 10000000:01000000:1.0:1789061786.805214:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789061786.805237:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061786.805246:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061786.805254:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061786.805332:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ece680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130747136:0@lo:101: 00000100:00100000:1.0:1789061786.805365:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061786.805392:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061786.805442:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130747136 00000100:00100000:3.0:1789061786.805446:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130747136 00000100:00100000:3.0:1789061786.805483:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789061786.805490:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130747136:12345-0@lo:101: 00010000:00010000:3.0:1789061786.805498:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061786.805510:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c3798200/0x2774d8f311dc64b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc64aa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061786.805529:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c3798200/0x2774d8f311dc64b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc64aa expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061786.805541:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c3798200/0x2774d8f311dc64b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc64aa expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061786.805549:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3798200, rc 0) 00000100:00100000:3.0:1789061786.805576:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130747136:12345-0@lo:101: Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061786.805582:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789061786.805732:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ece680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130747136:0@lo:101: 00010000:00010000:1.0:1789061786.805744:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc64b1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061786.805753:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc64b1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061786.805795:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ece680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130747264:0@lo:501: 00000100:00100000:1.0:1789061786.805819:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061786.805844:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061786.805890:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130747264 00000100:00100000:3.0:1789061786.806197:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130747264 00000100:00100000:3.0:1789061786.806275:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789061786.806283:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130747264:12345-0@lo:501: 00000100:00100000:3.0:1789061786.806382:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130747264:12345-0@lo:501: Request processed in 99us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061786.806388:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789061786.806680:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ece680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130747264:0@lo:501: 00000100:00100000:1.0:1789061786.806709:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ece680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130747392:0@lo:503: 00000100:00100000:1.0:1789061786.806747:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061786.806762:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789061786.806773:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130747392 00000100:00100000:1.0:1789061786.806776:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130747392 00000100:00100000:1.0:1789061786.806795:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789061786.806800:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130747392:12345-0@lo:503: 00000100:00100000:1.0:1789061786.806867:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130747392:12345-0@lo:503: Request processed in 66us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061786.806873:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789061786.813496:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ece680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130747392:0@lo:503: 00000100:00100000:0.0:1789061786.821708:0:8278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4504e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8278:1875967130747520:0@lo:502: 00000100:00100000:0.0:1789061786.821795:0:8278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061786.821841:0:8278:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061786.822054:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130747520 00000100:00100000:1.0:1789061786.822062:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130747520 00000100:00100000:1.0:1789061786.822110:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789061786.822119:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:8278:x1875967130747520:12345-0@lo:502: 00000100:00100000:1.0:1789061786.822216:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:8278:x1875967130747520:12345-0@lo:502: Request processed in 98us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061786.822223:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789061786.822436:0:8278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4504e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8278:1875967130747520:0@lo:502: 00000020:01000000:2.0:1789061786.822460:0:8278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061786.822468:0:8278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061786.822470:0:8278:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789061786.822481:0:8278:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767c3163000 00000020:00000080:2.0:1789061786.822484:0:8278:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789061786.822506:0:8278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8278:1875967130747648:0@lo:502: 00000100:00100000:2.0:1789061786.822540:0:8278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061786.822564:0:8278:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c5d45240 going to sleep for 11 seconds 00000100:00100000:1.0:1789061786.822680:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130747648 00000100:00100000:1.0:1789061786.822685:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130747648 00000100:00100000:1.0:1789061786.822711:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789061786.822724:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:8278:x1875967130747648:12345-0@lo:502: 00000100:00100000:1.0:1789061786.822780:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:8278:x1875967130747648:12345-0@lo:502: Request processed in 62us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061786.822786:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789061786.823031:0:8278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8278:1875967130747648:0@lo:502: 00000020:01000000:2.0:1789061786.823049:0:8278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061786.823053:0:8278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061786.823055:0:8278:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789061786.823058:0:8278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789061786.823156:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789061786.823175:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789061786.823184:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc64b1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061786.823195:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc64b1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061787.433937:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061788.458765:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789061788.830468:0:8404:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789061788.830477:0:8404:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789061788.830479:0:8404:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789061788.830627:0:8404:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9767fd12c000 00000020:01000004:3.0:1789061788.848198:0:8404:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789061788.848216:0:8404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789061788.848265:0:8404:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9767f38319c0) 00000020:00000080:3.0:1789061788.848286:0:8404:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789061788.899067:0:8404:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789061788.899119:0:8404:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1789061788.923449:0:8404:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789061788.923803:0:8404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789061788.923816:0:8404:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789061788.923826:0:8404:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2774d8f311dc64bf 00000020:01000004:0.0:1789061788.923834:0:8404:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789061788.923853:0:8404:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789061788.923861:0:8404:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789061788.923867:0:8404:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789061788.924264:0:8404:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789061788.924278:0:8404:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9767f38a99c0) 00000020:00000080:0.0:1789061788.924459:0:8404:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1789061788.931047:0:8404:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789061788.932204:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789061788.932212:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789061788.935955:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789061788.935965:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789061788.943997:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789061788.944008:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789061788.947114:0:8404:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061788.947279:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789061788.947343:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789061788.951228:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789061788.951239:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789061788.997299:0:8404:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061788.997535:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789061788.997542:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789061788.999763:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789061788.999777:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789061789.001873:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789061789.001887:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789061789.004346:0:8404:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061789.004533:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789061789.004539:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789061789.005813:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789061789.005823:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789061789.084685:0:8404:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789061789.086514:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789061789.086527:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789061789.091233:0:8404:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789061789.091390:0:8404:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789061789.092197:0:8404:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789061789.092226:0:8404:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789061789.092232:0:8404:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789061789.107125:0:8404:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789061789.107161:0:8404:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789061789.107165:0:8404:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789061789.107167:0:8404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789061789.107168:0:8404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789061789.107169:0:8404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789061789.107170:0:8404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789061789.107171:0:8404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789061789.107173:0:8404:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789061789.107174:0:8404:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789061789.107176:0:8404:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789061789.107177:0:8404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789061789.107178:0:8404:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789061789.107182:0:8404:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789061789.107185:0:8404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789061789.107186:0:8404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789061789.107187:0:8404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789061789.107188:0:8404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789061789.107189:0:8404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789061789.107190:0:8404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789061789.107191:0:8404:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789061789.107193:0:8404:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789061789.107194:0:8404:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789061789.107195:0:8404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789061789.107196:0:8404:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789061789.107221:0:8404:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789061789.107246:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130747776:0@lo:253: 00000100:00100000:3.0:1789061789.107316:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.107419:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061789.107497:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130747776 00000100:00100000:0.0:1789061789.107505:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130747776 00000100:00100000:0.0:1789061789.107599:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789061789.107637:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:8404:x1875967130747776:12345-0@lo:253: 20000000:01000000:0.0:1789061789.107678:0:6490:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789061789.107683:0:6490:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789061789.107688:0:6490:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789061789.107692:0:6490:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789061789.107889:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061789.108028:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789061789.108042:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789061789.108077:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789061789.108084:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789061789.108097:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789061789.108113:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789061789.108192:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789061789.108206:0:6490:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:0.0:1789061789.108208:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:0.0:1789061789.108223:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789061789.108230:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789061789.108244:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789061789.108258:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:0.0:1789061789.108276:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789061789.108282:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789061789.108309:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789061789.108327:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789061789.108394:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1789061789.108403:0:6490:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:0.0:1789061789.108405:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:0.0:1789061789.108416:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1789061789.108421:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789061789.108433:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1789061789.108437:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:0.0:1789061789.108448:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1789061789.108453:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789061789.108466:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1789061789.108481:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1789061789.108861:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1789061789.108873:0:6490:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:0.0:1789061789.108874:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:0.0:1789061789.108888:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1789061789.108894:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789061789.108922:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1789061789.108928:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:0.0:1789061789.108941:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1789061789.108946:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789061789.108958:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1789061789.108973:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1789061789.108985:0:6490:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789061789.108987:0:6490:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789061789.108990:0:6490:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789061789.109028:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789061789.109036:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789061789.109672:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789061789.109862:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789061789.109894:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789061789.109916:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789061789.109927:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789061789.109929:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789061789.110291:0:8424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789061789.110313:0:8424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789061789.110329:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1789061789.110462:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1789061789.110481:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1789061789.110495:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1789061789.110506:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789061789.110508:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789061789.110921:0:8425:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1789061789.110942:0:8425:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1789061789.110959:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789061789.111086:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789061789.111103:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789061789.111114:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789061789.111122:0:6490:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789061789.111124:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789061789.111471:0:8426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789061789.111490:0:8426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789061789.111504:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789061789.111649:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1789061789.111668:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1789061789.111681:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:2.0:1789061789.111696:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789061789.111715:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.111732:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c3799000/0x2774d8f311dc6399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6392 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.111740:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c1482600/0x2774d8f311dc6410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6409 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.111747:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97680204a400/0x2774d8f311dc6448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6441 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.111753:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc6464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc645d expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.111760:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97680204a800/0x2774d8f311dc648e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6487 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.111767:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.111809:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97680204a800/0x2774d8f311dc648e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6487 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.111821:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97680204a800/0x2774d8f311dc648e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6487 expref: 18 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061789.111833:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130747904:0@lo:104: 00000100:00100000:2.0:1789061789.111902:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061789.111959:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc6464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc645d expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.111967:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc6464 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc645d expref: 18 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061789.111976:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130748032:0@lo:104: 00000100:00100000:2.0:1789061789.112010:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061789.112035:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97680204a400/0x2774d8f311dc6448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6441 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.112042:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97680204a400/0x2774d8f311dc6448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6441 expref: 18 pid: 6488 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061789.112160:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130748160:0@lo:104: 00000100:00100000:2.0:1789061789.112195:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061789.112225:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c1482600/0x2774d8f311dc6410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6409 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.112234:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c1482600/0x2774d8f311dc6410 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6409 expref: 18 pid: 6490 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061789.112255:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130748288:0@lo:104: 00000100:00100000:2.0:1789061789.112277:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061789.112292:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c3799000/0x2774d8f311dc6399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6392 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.112300:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c3799000/0x2774d8f311dc6399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6392 expref: 18 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061789.112308:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130748416:0@lo:104: 00000100:00100000:2.0:1789061789.112326:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061789.112335:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c81e2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789061789.112359:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130747904 00000100:00100000:2.0:1789061789.112364:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130747904 00000100:00100000:2.0:1789061789.112392:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130748032 00000100:00100000:2.0:1789061789.112394:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130748032 00000100:00100000:2.0:1789061789.112402:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130748160 00000100:00100000:2.0:1789061789.112405:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130748160 00000100:00100000:2.0:1789061789.112413:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130748288 00000100:00100000:2.0:1789061789.112414:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130748288 00000100:00100000:2.0:1789061789.112422:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130748416 00000100:00100000:2.0:1789061789.112424:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130748416 00000100:00100000:2.0:1789061789.112437:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789061789.112444:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+7:6490:x1875967130747904:12345-0@lo:104: 00010000:00010000:2.0:1789061789.112457:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c3799400/0x2774d8f311dc6487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc648e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.112501:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789061789.112507:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+7:6490:x1875967130747904:12345-0@lo:104: Request processed in 63us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061789.112522:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789061789.112539:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789061789.112545:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:6490:x1875967130748032:12345-0@lo:104: 00010000:00010000:2.0:1789061789.112553:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff97680204ae00/0x2774d8f311dc645d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6464 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.112587:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789061789.112592:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:6490:x1875967130748032:12345-0@lo:104: Request processed in 48us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061789.112598:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789061789.112630:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789061789.112637:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:6490:x1875967130748160:12345-0@lo:104: 00010000:00010000:2.0:1789061789.112644:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff97680204ac00/0x2774d8f311dc6441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6448 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.112676:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789061789.112681:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:6490:x1875967130748160:12345-0@lo:104: Request processed in 46us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061789.112687:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789061789.112699:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789061789.112705:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6490:x1875967130748288:12345-0@lo:104: 00010000:00010000:2.0:1789061789.112712:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6410 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.112736:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789061789.112741:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6490:x1875967130748288:12345-0@lo:104: Request processed in 36us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061789.112752:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789061789.112764:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789061789.112770:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:6490:x1875967130748416:12345-0@lo:104: 00010000:00010000:2.0:1789061789.112778:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc6392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6399 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.112815:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789061789.112820:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:6490:x1875967130748416:12345-0@lo:104: Request processed in 51us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061789.112826:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789061789.112843:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789061789.112849:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c3799400/0x2774d8f311dc6487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc648e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.112856:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799400 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061789.112860:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799400/0x2774d8f311dc6487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc648e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.112868:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c3799400/0x2774d8f311dc6487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc648e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113184:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789061789.113190:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff97680204ae00/0x2774d8f311dc645d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6464 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113205:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97680204ae00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789061789.113208:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff97680204ae00/0x2774d8f311dc645d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6464 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113215:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff97680204ae00/0x2774d8f311dc645d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6464 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061789.113223:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff97680204ae00/0x2774d8f311dc645d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6464 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061789.113229:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789061789.113266:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff97680204ae00/0x2774d8f311dc645d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6464 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113273:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061789.113288:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff97680204ae00/0x2774d8f311dc645d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6464 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113295:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff97680204ae00/0x2774d8f311dc645d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6464 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113308:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789061789.113311:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff97680204ac00/0x2774d8f311dc6441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6448 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113318:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97680204ac00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789061789.113321:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff97680204ac00/0x2774d8f311dc6441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6448 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113339:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff97680204ac00/0x2774d8f311dc6441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6448 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061789.113346:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff97680204ac00/0x2774d8f311dc6441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6448 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061789.113352:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789061789.113367:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff97680204ac00/0x2774d8f311dc6441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6448 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113372:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789061789.113415:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1789061789.113437:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff97680204ac00/0x2774d8f311dc6441 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6448 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113444:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff97680204ac00/0x2774d8f311dc6441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6448 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113453:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789061789.113457:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6410 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113462:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030400 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789061789.113466:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6410 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113473:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6410 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061789.113480:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6410 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061789.113491:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789061789.113505:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6409 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6410 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.113511:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1789061789.113540:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799400/0x2774d8f311dc6487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc648e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061789.113545:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061789.113561:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c3799400/0x2774d8f311dc6487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc648e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.113567:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061789.113580:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c3799400/0x2774d8f311dc6487 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc648e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.113587:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c3799400/0x2774d8f311dc6487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc648e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.113596:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061789.113599:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc6392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6399 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.113628:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799800 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061789.113631:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc6392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6399 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.113639:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc6392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6399 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061789.113646:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc6392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6399 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061789.113652:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061789.113665:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc6392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6399 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.113670:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061789.113674:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc6392 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6399 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.113680:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc6392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6399 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.113689:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061789.113696:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061789.113697:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061789.113704:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061789.113772:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130748544:0@lo:103: 00000100:00100000:0.0:1789061789.113815:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061789.113855:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130749056:0@lo:103: 00000100:00100000:0.0:1789061789.113886:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061789.113913:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061789.113919:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130748928:0@lo:103: 00000100:00100000:0.0:1789061789.113937:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061789.113956:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789061789.113962:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130748800:0@lo:103: 00000100:00100000:0.0:1789061789.113991:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061789.114009:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130748544 00000100:00100000:0.0:1789061789.114014:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130748544 00010000:00010000:0.0:1789061789.114034:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc6464 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc645d expref: 19 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061789.114061:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130749056 00000100:00100000:0.0:1789061789.114063:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130749056 00010000:00010000:0.0:1789061789.114072:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c3799000/0x2774d8f311dc6399 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6392 expref: 20 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061789.114080:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130748928 00000100:00100000:0.0:1789061789.114082:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130748928 00010000:00010000:0.0:1789061789.114089:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97680204a800/0x2774d8f311dc648e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6487 expref: 21 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061789.114097:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130748800 00000100:00100000:0.0:1789061789.114099:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130748800 00010000:00010000:0.0:1789061789.114106:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c1482600/0x2774d8f311dc6410 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6409 expref: 22 pid: 6490 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061789.114128:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789061789.114133:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:3621:x1875967130748544:12345-0@lo:103: 00010000:00010000:0.0:1789061789.114143:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061789.114148:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc6464 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc645d expref: 22 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.114158:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc6464 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc645d expref: 22 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.114171:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061789.114196:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:3621:x1875967130748544:12345-0@lo:103: Request processed in 63us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.114202:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789061789.114215:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789061789.114219:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4505880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3621:x1875967130749056:12345-0@lo:103: 00010000:00010000:0.0:1789061789.114225:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061789.114229:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c3799000/0x2774d8f311dc6399 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6392 expref: 21 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.114236:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c3799000/0x2774d8f311dc6399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6392 expref: 21 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.114244:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061789.114259:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4505880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3621:x1875967130749056:12345-0@lo:103: Request processed in 40us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.114264:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789061789.114272:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789061789.114282:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4504000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:3621:x1875967130748928:12345-0@lo:103: 00010000:00010000:0.0:1789061789.114288:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061789.114292:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97680204a800/0x2774d8f311dc648e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6487 expref: 20 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.114301:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97680204a800/0x2774d8f311dc648e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6487 expref: 20 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.114309:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061789.114325:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4504000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:3621:x1875967130748928:12345-0@lo:103: Request processed in 43us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.114330:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789061789.114339:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789061789.114344:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4506300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:3622:x1875967130748800:12345-0@lo:103: 00010000:00010000:0.0:1789061789.114358:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061789.114362:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c1482600/0x2774d8f311dc6410 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6409 expref: 19 pid: 6490 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.114370:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c1482600/0x2774d8f311dc6410 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6409 expref: 19 pid: 6490 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.114378:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061789.114397:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4506300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:3622:x1875967130748800:12345-0@lo:103: Request processed in 54us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.114403:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789061789.114431:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130748800:0@lo:103: 00000100:00100000:0.0:1789061789.114450:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130748928:0@lo:103: 00000100:00100000:0.0:1789061789.114456:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130748544:0@lo:103: 00000100:00100000:0.0:1789061789.114469:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130749056:0@lo:103: 00010000:00010000:0.0:1789061789.114504:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97680204a800/0x2774d8f311dc648e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6487 expref: 18 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061789.114513:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130747904:0@lo:104: 00010000:00010000:0.0:1789061789.114522:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc6464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc645d expref: 17 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061789.114529:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130748032:0@lo:104: 00000100:00100000:0.0:1789061789.114535:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130748160:0@lo:104: 00010000:00010000:0.0:1789061789.114542:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1482600/0x2774d8f311dc6410 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6409 expref: 16 pid: 6490 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061789.114549:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130748288:0@lo:104: 00010000:00010000:0.0:1789061789.114556:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3799000/0x2774d8f311dc6399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6392 expref: 15 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061789.114563:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6490:1875967130748416:0@lo:104: 00010000:00010000:0.0:1789061789.114580:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061789.114848:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130748672:0@lo:103: 00000100:00100000:3.0:1789061789.114933:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789061789.115156:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6409 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6410 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.115164:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6409 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6410 expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.115179:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061789.115181:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061789.115183:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061789.115218:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130748672 00000100:00100000:0.0:1789061789.115222:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130748672 00010000:00010000:0.0:1789061789.115240:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97680204a400/0x2774d8f311dc6448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6441 expref: 15 pid: 6488 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061789.115294:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789061789.115301:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:3623:x1875967130748672:12345-0@lo:103: 00010000:00010000:0.0:1789061789.115316:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061789.115320:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97680204a400/0x2774d8f311dc6448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6441 expref: 15 pid: 6488 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.115330:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97680204a400/0x2774d8f311dc6448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6441 expref: 15 pid: 6488 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.115341:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97680204a400/0x2774d8f311dc6448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6441 expref: 15 pid: 6488 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.115353:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.115361:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.115374:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.115381:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.115389:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.115395:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.115401:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1482c00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789061789.115405:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.115420:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.115435:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.115443:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061789.115504:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:3623:x1875967130748672:12345-0@lo:103: Request processed in 203us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.115510:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789061789.115651:0:6490:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.115659:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.115666:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc64cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789061789.115676:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789061789.116371:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130748672:0@lo:103: 00000100:00100000:0.0:1789061789.118899:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:8404:x1875967130747776:12345-0@lo:253: Request processed in 11258us (11576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.118922:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789061789.119200:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130747776:0@lo:253: 10000000:01000000:3.0:1789061789.119215:0:8404:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789061789.119218:0:8404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789061789.119219:0:8404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789061789.119221:0:8404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789061789.119222:0:8404:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789061789.119224:0:8404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789061789.119235:0:8404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789061789.119237:0:8404:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789061789.119238:0:8404:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789061789.119240:0:8404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789061789.119241:0:8404:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789061789.119265:0:8404:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9767fd12c000 from lustre-OST0000 10000000:01000000:3.0:1789061789.119294:0:8404:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789061789.119296:0:8404:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789061789.119304:0:8404:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9767f38a8000 local copy 10000000:01000000:3.0:1789061789.119308:0:8404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789061789.119340:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.119350:0:8404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.119359:0:8404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061789.119375:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130749184:0@lo:101: 00000100:00100000:3.0:1789061789.119411:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.119447:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 11 seconds 00000100:00100000:0.0:1789061789.119535:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130749184 00000100:00100000:0.0:1789061789.119541:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130749184 00000100:00100000:0.0:1789061789.119581:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789061789.119589:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:8404:x1875967130749184:12345-0@lo:101: 00010000:00010000:0.0:1789061789.119642:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061789.119655:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0031400/0x2774d8f311dc64db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc64d4 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.119678:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031400/0x2774d8f311dc64db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc64d4 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.119688:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0031400/0x2774d8f311dc64db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc64d4 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.119697:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031400, rc 0) 00000100:00100000:0.0:1789061789.119736:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130749184:12345-0@lo:101: Request processed in 148us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.119743:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789061789.119982:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130749184:0@lo:101: 00010000:00010000:3.0:1789061789.119994:0:8404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2774d8f311dc64db expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.120002:0:8404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2774d8f311dc64db expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061789.120153:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130749312:0@lo:501: 00000100:00100000:3.0:1789061789.120181:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.120207:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 11 seconds 00000100:00100000:0.0:1789061789.120259:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130749312 00000100:00100000:0.0:1789061789.120264:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130749312 00000100:00100000:0.0:1789061789.120295:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789061789.120302:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130749312:12345-0@lo:501: 00000100:00100000:0.0:1789061789.120369:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130749312:12345-0@lo:501: Request processed in 66us (187us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789061789.120376:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789061789.120442:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130749312:0@lo:501: 10000000:01000000:3.0:1789061789.120455:0:8404:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789061789.120472:0:8404:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789061789.120478:0:8404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2774d8f311dc64db expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.120487:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2774d8f311dc64db expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.120494:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2774d8f311dc64db expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.120518:0:8404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789061789.120537:0:8404:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9767fd12c000 10000000:01000000:3.0:1789061789.120542:0:8404:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789061789.120547:0:8404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789061789.120550:0:8404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789061789.120554:0:8404:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789061789.120557:0:8404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789061789.120572:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.120580:0:8404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.120587:0:8404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061789.120599:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130749440:0@lo:101: 00000100:00100000:3.0:1789061789.120673:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.120693:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7300 going to sleep for 11 seconds 00010000:00010000:2.0:1789061789.120748:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061789.120755:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2774d8f311dc64db expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.120763:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799600 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061789.120767:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2774d8f311dc64db expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.120775:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2774d8f311dc64db expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061789.120783:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2774d8f311dc64db expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061789.120789:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061789.120808:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2774d8f311dc64db expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.120815:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061789.120840:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2774d8f311dc64db expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.120848:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c3799600/0x2774d8f311dc64d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2774d8f311dc64db expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.120860:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061789.120862:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061789.120863:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061789.120883:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061789.120900:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130749568:0@lo:103: 00000100:00100000:2.0:1789061789.120940:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061789.120974:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130749568 00000100:00100000:2.0:1789061789.120979:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130749568 00000100:00100000:2.0:1789061789.121009:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789061789.121017:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:3623:x1875967130749568:12345-0@lo:103: 00010000:00010000:2.0:1789061789.121027:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061789.121039:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031400/0x2774d8f311dc64db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc64d4 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.121190:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061789.121222:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:3623:x1875967130749568:12345-0@lo:103: Request processed in 205us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061789.121229:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789061789.121261:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130749568:0@lo:103: 00000100:00100000:0.0:1789061789.121343:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130749440 00000100:00100000:0.0:1789061789.121348:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130749440 00000100:00100000:0.0:1789061789.121384:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789061789.121391:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+13:8404:x1875967130749440:12345-0@lo:101: 00010000:00010000:0.0:1789061789.121399:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061789.121411:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc64e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc64e2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.121428:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc64e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc64e2 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.121437:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc64e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc64e2 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.121445:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031e00, rc 0) 00000100:00100000:0.0:1789061789.121483:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130749440:12345-0@lo:101: Request processed in 93us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.121489:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789061789.121662:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130749440:0@lo:101: 00010000:00010000:3.0:1789061789.121674:0:8404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc64e9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.121684:0:8404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc64e9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061789.121749:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130749696:0@lo:501: 00000100:00100000:3.0:1789061789.121775:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.121793:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1789061789.121834:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130749696 00000100:00100000:0.0:1789061789.121845:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130749696 00000100:00100000:0.0:1789061789.121954:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789061789.121961:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130749696:12345-0@lo:501: 00000100:00100000:0.0:1789061789.122130:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130749696:12345-0@lo:501: Request processed in 169us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.122137:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789061789.122282:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130749696:0@lo:501: 00000100:00100000:3.0:1789061789.122309:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130749824:0@lo:503: 00000100:00100000:3.0:1789061789.122349:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.122371:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1789061789.122413:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130749824 00000100:00100000:2.0:1789061789.122418:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130749824 00000100:00100000:2.0:1789061789.122449:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789061789.122456:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130749824:12345-0@lo:503: 00000100:00100000:2.0:1789061789.122541:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130749824:12345-0@lo:503: Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061789.122548:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789061789.122739:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130749824:0@lo:503: 00000040:00080000:3.0:1789061789.124406:0:8404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789061789.124505:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130749952:0@lo:502: 00000100:00100000:3.0:1789061789.124579:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.124635:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1789061789.124791:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130749952 00000100:00100000:1.0:1789061789.124799:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130749952 00000100:00100000:1.0:1789061789.124842:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789061789.124850:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130749952:12345-0@lo:502: 00000100:00100000:1.0:1789061789.125143:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130749952:12345-0@lo:502: Request processed in 293us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061789.125157:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789061789.125246:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130749952:0@lo:502: 00000040:00080000:3.0:1789061789.125457:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789061789.125484:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789061789.125501:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789061789.125515:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789061789.125547:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789061789.125560:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789061789.125580:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750080:0@lo:502: 00000100:00100000:3.0:1789061789.125648:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.125662:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1789061789.125755:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130750080 00000100:00100000:0.0:1789061789.125761:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130750080 00000100:00100000:0.0:1789061789.125794:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789061789.125801:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130750080:12345-0@lo:502: 00000100:00100000:0.0:1789061789.125888:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130750080:12345-0@lo:502: Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.125895:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789061789.126176:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750080:0@lo:502: 00000040:00080000:3.0:1789061789.126220:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789061789.126228:0:8404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789061789.126737:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789061789.126745:0:8427:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789061789.126751:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061789.126753:0:8427:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789061789.126758:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789061789.126772:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9767f38ab380) 00000020:00000080:0.0:1789061789.126791:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789061789.126798:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789061789.126957:0:8427:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767fd12c000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789061789.126968:0:8427:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789061789.126985:0:8427:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2774d8f311dc64f7 00010000:00010000:0.0:1789061789.138836:0:8427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1789061789.139350:0:8427:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789061789.144398:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789061789.144819:0:8427:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1789061789.153030:0:8427:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789061789.153201:0:8427:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789061789.168973:0:8427:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789061789.174744:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789061789.174758:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061789.174763:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061789.174766:0:8427:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789061789.174770:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061789.174774:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061789.174780:0:8427:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789061789.174784:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789061789.174786:0:8427:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789061789.174811:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061789.174814:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061789.174816:0:8427:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789061789.174819:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789061789.174971:0:8404:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789061789.174999:0:8404:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789061789.175022:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc64e9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.175035:0:8404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc64e9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061789.175043:0:8404:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fd12c000 from 1 10000000:01000000:3.0:1789061789.175045:0:8404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789061789.175088:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.175097:0:8404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.175106:0:8404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061789.175128:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750208:0@lo:101: 00000100:00100000:3.0:1789061789.175199:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.175247:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061789.176471:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130750208 00000100:00100000:1.0:1789061789.176482:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130750208 00000100:00100000:1.0:1789061789.176532:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789061789.176542:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:8404:x1875967130750208:12345-0@lo:101: 00010000:00010000:1.0:1789061789.176557:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061789.176571:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47a200/0x2774d8f311dc6505 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc64fe expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.176595:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47a200/0x2774d8f311dc6505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc64fe expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.176630:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47a200/0x2774d8f311dc6505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc64fe expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.176640:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a200, rc 0) 00000100:00100000:1.0:1789061789.176693:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8404:x1875967130750208:12345-0@lo:101: Request processed in 153us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061789.176700:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789061789.177011:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750208:0@lo:101: 00010000:00010000:3.0:1789061789.177029:0:8404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6505 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.177039:0:8404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6505 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061789.177143:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750336:0@lo:501: 00000100:00100000:3.0:1789061789.177173:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.177315:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061789.177899:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130750336 00000100:00100000:2.0:1789061789.177916:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130750336 00000100:00100000:2.0:1789061789.177954:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789061789.177963:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8404:x1875967130750336:12345-0@lo:501: 00000100:00100000:2.0:1789061789.178062:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8404:x1875967130750336:12345-0@lo:501: Request processed in 100us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061789.178070:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789061789.178217:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750336:0@lo:501: 00000100:00100000:3.0:1789061789.178251:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750464:0@lo:503: 00000100:00100000:3.0:1789061789.178295:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.178324:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061789.178365:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130750464 00000100:00100000:0.0:1789061789.178370:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130750464 00000100:00100000:0.0:1789061789.178401:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789061789.178408:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8404:x1875967130750464:12345-0@lo:503: 00000100:00100000:0.0:1789061789.178495:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8404:x1875967130750464:12345-0@lo:503: Request processed in 87us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.178501:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789061789.181218:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750464:0@lo:503: 00000040:00080000:3.0:1789061789.181467:0:8404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789061789.181544:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750592:0@lo:502: 00000100:00100000:3.0:1789061789.181622:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.181657:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061789.184223:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130750592 00000100:00100000:1.0:1789061789.184235:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130750592 00000100:00100000:1.0:1789061789.184291:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789061789.184301:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8404:x1875967130750592:12345-0@lo:502: 00000100:00100000:1.0:1789061789.184448:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8404:x1875967130750592:12345-0@lo:502: Request processed in 147us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061789.184456:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789061789.186646:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750592:0@lo:502: 00000040:00080000:3.0:1789061789.186876:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789061789.186917:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789061789.186949:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750720:0@lo:502: 00000100:00100000:3.0:1789061789.187010:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.187042:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061789.187175:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130750720 00000100:00100000:2.0:1789061789.187330:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130750720 00000100:00100000:2.0:1789061789.187380:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789061789.187389:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8404:x1875967130750720:12345-0@lo:502: 00000100:00100000:2.0:1789061789.187500:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8404:x1875967130750720:12345-0@lo:502: Request processed in 112us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061789.187508:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789061789.188803:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750720:0@lo:502: 00000040:00080000:3.0:1789061789.188895:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789061789.188916:0:8404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789061789.190445:0:8431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061789.190456:0:8431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061789.190458:0:8431:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789061789.190466:0:8431:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767fd12c000 00000020:00000080:0.0:1789061789.190468:0:8431:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789061789.190480:0:8431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061789.190483:0:8431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061789.190485:0:8431:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789061789.190488:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789061789.190584:0:8404:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789061789.190626:0:8404:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789061789.190644:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6505 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.190657:0:8404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6505 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061789.190704:0:8404:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789061789.190707:0:8404:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9767fd12c000 10000000:01000000:3.0:1789061789.190710:0:8404:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9767fd12c000 10000000:01000000:3.0:1789061789.190714:0:8404:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789061789.190719:0:8404:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767fd12c000 from 1 10000000:01000000:3.0:1789061789.190722:0:8404:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789061789.190755:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.190764:0:8404:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.190776:0:8404:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061789.190797:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750848:0@lo:101: 00000100:00100000:3.0:1789061789.190860:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.190920:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061789.190934:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130750848 00000100:00100000:0.0:1789061789.190940:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130750848 00000100:00100000:0.0:1789061789.190989:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789061789.190998:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8404:x1875967130750848:12345-0@lo:101: 00010000:00010000:0.0:1789061789.191010:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061789.191022:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0030e00/0x2774d8f311dc6513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc650c expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.191045:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0030e00/0x2774d8f311dc6513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc650c expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.191056:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0030e00/0x2774d8f311dc6513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc650c expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.191075:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030e00, rc 0) 00000100:00100000:0.0:1789061789.191123:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:8404:x1875967130750848:12345-0@lo:101: Request processed in 126us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.191130:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789061789.191285:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750848:0@lo:101: 00010000:00010000:3.0:1789061789.191306:0:8404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6513 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.191314:0:8404:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6513 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061789.191387:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750976:0@lo:501: 00000100:00100000:3.0:1789061789.191413:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.191439:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061789.191498:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130750976 00000100:00100000:1.0:1789061789.191504:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130750976 00000100:00100000:1.0:1789061789.191557:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789061789.191565:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:8404:x1875967130750976:12345-0@lo:501: 00000100:00100000:1.0:1789061789.191691:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:8404:x1875967130750976:12345-0@lo:501: Request processed in 127us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061789.191698:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789061789.191811:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130750976:0@lo:501: 00000100:00100000:3.0:1789061789.191837:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130751104:0@lo:503: 00000100:00100000:3.0:1789061789.191968:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.191996:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061789.192368:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130751104 00000100:00100000:0.0:1789061789.192375:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130751104 00000100:00100000:0.0:1789061789.192411:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789061789.192418:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:8404:x1875967130751104:12345-0@lo:503: 00000100:00100000:0.0:1789061789.192511:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:8404:x1875967130751104:12345-0@lo:503: Request processed in 94us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.192518:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789061789.192602:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130751104:0@lo:503: 00000040:00080000:3.0:1789061789.192822:0:8404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789061789.193274:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130751232:0@lo:502: 00000100:00100000:3.0:1789061789.193317:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.193351:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061789.193365:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130751232 00000100:00100000:0.0:1789061789.193370:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130751232 00000100:00100000:0.0:1789061789.193403:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789061789.193410:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:8404:x1875967130751232:12345-0@lo:502: 00000100:00100000:0.0:1789061789.193496:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:8404:x1875967130751232:12345-0@lo:502: Request processed in 86us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.193502:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789061789.198112:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130751232:0@lo:502: 00000040:00080000:3.0:1789061789.198360:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789061789.198392:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789061789.198407:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789061789.198421:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789061789.198433:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789061789.198445:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789061789.198459:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789061789.198472:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789061789.198496:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789061789.198511:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789061789.198540:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789061789.198555:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789061789.198568:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789061789.198580:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789061789.198637:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789061789.198654:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789061789.198665:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789061789.198677:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789061789.198688:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789061789.198700:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789061789.198713:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789061789.198725:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789061789.198739:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789061789.198754:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789061789.198767:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789061789.198781:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789061789.198792:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789061789.198802:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789061789.198812:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789061789.198824:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789061789.198847:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789061789.198862:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789061789.198885:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789061789.198901:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789061789.198926:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789061789.198938:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789061789.198950:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1789061789.198982:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130751360:0@lo:502: 00000100:00100000:3.0:1789061789.199049:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.199089:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061789.199752:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130751360 00000100:00100000:1.0:1789061789.199761:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130751360 00000100:00100000:1.0:1789061789.199809:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789061789.199818:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:8404:x1875967130751360:12345-0@lo:502: 00000100:00100000:1.0:1789061789.199968:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:8404:x1875967130751360:12345-0@lo:502: Request processed in 151us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061789.199976:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789061789.200052:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130751360:0@lo:502: 00000040:00080000:0.0:1789061789.200106:0:8404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789061789.200116:0:8404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789061789.204545:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789061789.204564:0:8432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9767f38acd40) 00000020:00000080:0.0:1789061789.204587:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789061789.204832:0:8432:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767fd12c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789061789.204836:0:8432:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767fd12c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789061789.204839:0:8432:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fd12c000 3 00010000:00080000:2.0:1789061789.204878:0:8432:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767fd2c5000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1789061789.206966:0:8432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1789061789.207159:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789061789.207199:0:8432:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789061789.207210:0:8432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2774d8f311dc6521 00000100:00080000:2.0:1789061789.207219:0:8432:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789061789.207233:0:8432:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9767fd2c5000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789061789.207266:0:8432:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c56fce00 x1875967130751488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789061789.207286:0:8432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1789061789.207481:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789061789.207495:0:8432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9767fb3299c0) 00000020:00000080:2.0:1789061789.207506:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1789061789.207571:0:8432:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767fd12c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789061789.207575:0:8432:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767fd12c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789061789.207577:0:8432:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fd12c000 3 00010000:00080000:2.0:1789061789.207602:0:8432:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767fd2c3000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.103@tcp at head 00000100:00100000:3.0:1789061789.208053:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130751616:0@lo:400: 00000100:00100000:0.0:1789061789.208096:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875967130751488:0@lo:38: 00000100:00100000:3.0:1789061789.208110:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061789.208133:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.208141:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061789.208147:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130752000:0@lo:400: 00000100:00100000:3.0:1789061789.208170:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061789.208173:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130751616 00000100:00100000:0.0:1789061789.208179:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130751616 00000100:00100000:0.0:1789061789.208211:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130751488 00000100:00100000:0.0:1789061789.208214:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130751488 00000100:00100000:0.0:1789061789.208227:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789061789.208235:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130751616:12345-0@lo:400: 00000100:00100000:3.0:1789061789.208267:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130751744:0@lo:400: 00010000:00010000:2.0:1789061789.214217:0:8432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:3.0:1789061789.219225:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.219277:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061789.219290:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130751872:0@lo:400: 00000100:00100000:3.0:1789061789.219329:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.219370:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789061789.219378:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789061789.219399:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130752000 00000100:00100000:3.0:1789061789.219406:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130752000 00000100:00100000:3.0:1789061789.219444:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130751744 00000100:00100000:3.0:1789061789.219447:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130751744 00000100:00100000:3.0:1789061789.219463:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789061789.219471:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130752000:12345-0@lo:400: 00000100:00100000:3.0:1789061789.219680:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130752000:12345-0@lo:400: Request processed in 207us (11506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061789.219688:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789061789.219707:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789061789.219713:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130751744:12345-0@lo:400: 00000100:00100000:3.0:1789061789.219749:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130751744:12345-0@lo:400: Request processed in 37us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061789.219755:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789061789.219971:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130752000:0@lo:400: 00010000:00080000:3.0:1789061789.220003:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9767f4571f80 x1875967130751616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061789.220014:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130751616:0@lo:400: 00000100:00100000:3.0:1789061789.220046:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130751744:0@lo:400: 00000100:00100000:3.0:1789061789.220091:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130751872 00000100:00100000:3.0:1789061789.220095:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130751872 00000100:00100000:3.0:1789061789.220114:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789061789.220121:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789061789.220127:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130751872:12345-0@lo:400: 00000100:00100000:3.0:1789061789.220623:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130751872:12345-0@lo:400: Request processed in 52us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061789.220634:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789061789.220647:0:6496:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789061789.220654:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061789.220660:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875967130751488:12345-0@lo:38: 00010000:00080000:3.0:1789061789.220682:0:6496:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1789061789.220723:0:6496:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2774d8f311dc652f 00000004:00100000:3.0:1789061789.220738:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789061789.220767:0:6496:0:(import.c:65:import_set_state_nolock()) ffff9766c56eb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061789.220814:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875967130751488:12345-0@lo:38: Request processed in 152us (12679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061789.220821:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789061789.220852:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9767f4571880 x1875967130751872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061789.220863:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130751872:0@lo:400: 00010000:00080000:3.0:1789061789.221495:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766c56fce00 x1875967130751488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789061799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061789.221504:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789061789.221511:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789061789.221634:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789061789.221640:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789061789.221643:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789061789.221649:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875967130751488:0@lo:38: 00000100:00100000:0.0:1789061789.224876:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130751616:12345-0@lo:400: Request processed in 16633us (16757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061789.224889:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:00000080:2.0:1789061789.227079:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789061789.227121:0:8432:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789061789.227132:0:8432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2774d8f311dc6536 00000100:00080000:2.0:1789061789.227142:0:8432:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789061789.227152:0:8432:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9767fd2c3000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789061789.227182:0:8432:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c56fca80 x1875967130752128/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789061789.227209:0:8432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789061789.227268:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875967130752128:0@lo:38: 00000100:00100000:3.0:1789061789.227332:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.227382:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130752128 00000100:00100000:3.0:1789061789.227389:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130752128 00000100:00100000:3.0:1789061789.227414:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789061789.227421:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875967130752128:12345-0@lo:38: 00010000:00080000:3.0:1789061789.227443:0:6496:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1789061789.227471:0:6496:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2774d8f311dc653d 00000004:00100000:3.0:1789061789.227484:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789061789.227511:0:6496:0:(import.c:65:import_set_state_nolock()) ffff9766c56ed800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061789.227576:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875967130752128:12345-0@lo:38: Request processed in 154us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061789.227583:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:3.0:1789061789.227837:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1789061789.228017:0:8404:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789061789.228044:0:8404:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789061789.228066:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6513 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061789.228077:0:8404:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6513 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789061789.228120:0:8404:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789061789.228122:0:8404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789061789.228124:0:8404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061789.228125:0:8404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061789.228126:0:8404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061789.228127:0:8404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061789.228128:0:8404:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789061789.228130:0:8404:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789061789.228131:0:8404:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789061789.228132:0:8404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061789.228133:0:8404:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789061789.228140:0:8404:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789061789.228143:0:8404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789061789.228144:0:8404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789061789.228145:0:8404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789061789.228146:0:8404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789061789.228146:0:8404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789061789.228148:0:8404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789061789.228148:0:8404:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789061789.228149:0:8404:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789061789.228150:0:8404:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789061789.228151:0:8404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789061789.228152:0:8404:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789061789.228166:0:8404:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789061789.228178:0:8404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130752256:0@lo:253: 00000100:00100000:1.0:1789061789.228228:0:8404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061789.228252:0:8404:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c8bd8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789061789.228253:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130752256 00000100:00100000:0.0:1789061789.228258:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130752256 00000100:00100000:0.0:1789061789.228444:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789061789.228453:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:8404:x1875967130752256:12345-0@lo:253: 20000000:01000000:0.0:1789061789.228472:0:6491:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789061789.228484:0:6491:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1789061789.229535:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766c56fca80 x1875967130752128/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789061799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061789.229547:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789061789.229554:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789061789.229562:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789061789.229567:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789061789.229570:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c3000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789061789.229582:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875967130752128:0@lo:38: 20000000:01000000:2.0:1789061789.245670:0:6491:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789061789.245684:0:6491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789061789.245889:0:6512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789061789.245893:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789061789.245922:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.245940:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97680204aa00/0x2774d8f311dc643a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6433 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.245947:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc644f expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.245953:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.246004:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc644f expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.246019:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6456 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc644f expref: 16 pid: 6490 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061789.246033:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4505880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130752384:0@lo:104: 00000100:00100000:0.0:1789061789.246095:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061789.246149:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97680204aa00/0x2774d8f311dc643a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6433 expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061789.246158:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97680204aa00/0x2774d8f311dc643a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6433 expref: 16 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061789.246167:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4504000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130752512:0@lo:104: 00000100:00100000:0.0:1789061789.246185:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c15cae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789061789.246275:0:7437:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789061789.246299:0:7437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.246326:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130752384 00000100:00100000:3.0:1789061789.246333:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130752384 00000100:00100000:3.0:1789061789.246388:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130752512 00000100:00100000:3.0:1789061789.246392:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130752512 00000100:00100000:3.0:1789061789.246408:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789061789.246417:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fbda1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6512:x1875967130752384:12345-0@lo:104: 00010000:00010000:3.0:1789061789.246430:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff97680204a000/0x2774d8f311dc644f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6456 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.246488:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789061789.246494:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fbda1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6512:x1875967130752384:12345-0@lo:104: Request processed in 79us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061789.246501:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789061789.246550:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789061789.246557:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:6512:x1875967130752512:12345-0@lo:104: 00010000:00010000:3.0:1789061789.246566:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff97680204b200/0x2774d8f311dc6433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc643a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.246599:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789061789.246628:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:6512:x1875967130752512:12345-0@lo:104: Request processed in 49us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061789.246634:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789061789.246650:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789061789.246655:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff97680204a000/0x2774d8f311dc644f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6456 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061789.246659:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4505880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130752384:0@lo:104: 00010000:00010000:3.0:1789061789.246662:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97680204a000 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789061789.246666:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff97680204a000/0x2774d8f311dc644f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6456 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061789.246668:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4504000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130752512:0@lo:104: 00010000:00010000:3.0:1789061789.246674:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff97680204a000/0x2774d8f311dc644f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6456 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.246683:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061789.246687:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff97680204a000/0x2774d8f311dc644f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6456 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061789.246693:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061789.246697:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061789.246701:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff97680204b200/0x2774d8f311dc6433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc643a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.246707:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97680204b200 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061789.246710:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff97680204b200/0x2774d8f311dc6433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc643a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.246717:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff97680204a000/0x2774d8f311dc644f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6456 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.246723:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061789.246739:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff97680204a000/0x2774d8f311dc644f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6456 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.246746:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff97680204a000/0x2774d8f311dc644f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6456 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.246758:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061789.246760:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061789.246761:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061789.246773:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130752640:0@lo:103: 00000100:00100000:3.0:1789061789.246800:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061789.246839:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130752640 00000100:00100000:3.0:1789061789.246843:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130752640 00010000:00010000:3.0:1789061789.246859:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6456 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc644f expref: 17 pid: 6490 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.246859:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff97680204b200/0x2774d8f311dc6433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc643a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061789.246867:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff97680204b200/0x2774d8f311dc6433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc643a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061789.246872:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061789.246887:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff97680204b200/0x2774d8f311dc6433 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc643a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.246892:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061789.246917:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff97680204b200/0x2774d8f311dc6433 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc643a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.246934:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff97680204b200/0x2774d8f311dc6433 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc643a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061789.246948:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061789.246950:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061789.246952:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061789.246962:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130752768:0@lo:103: 00000100:00100000:2.0:1789061789.246988:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061789.249148:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:8404:x1875967130752256:12345-0@lo:253: Request processed in 20689us (20912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061789.249160:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789061789.249217:0:8404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8404:1875967130752256:0@lo:253: 10000000:01000000:2.0:1789061789.249230:0:8404:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789061789.249234:0:8404:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789061789.249236:0:8404:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789061789.249237:0:8404:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061789.249238:0:8404:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061789.249240:0:8404:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061789.249241:0:8404:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061789.249242:0:8404:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061789.249244:0:8404:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789061789.249245:0:8404:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789061789.249247:0:8404:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061789.249248:0:8404:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789061789.249259:0:8404:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789061789.249302:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130752768 00000100:00100000:3.0:1789061789.249310:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130752768 00010000:00010000:3.0:1789061789.249336:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97680204aa00/0x2774d8f311dc643a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6433 expref: 17 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061789.249360:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789061789.249377:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:3623:x1875967130752640:12345-0@lo:103: 00010000:00010000:3.0:1789061789.249389:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061789.249395:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6456 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc644f expref: 17 pid: 6490 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249407:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc644f expref: 17 pid: 6490 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249422:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6456 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc644f expref: 17 pid: 6490 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249436:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061789.249468:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:3623:x1875967130752640:12345-0@lo:103: Request processed in 92us (2667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061789.249474:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789061789.249489:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789061789.249495:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:3620:x1875967130752768:12345-0@lo:103: 00010000:00010000:3.0:1789061789.249502:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061789.249506:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97680204aa00/0x2774d8f311dc643a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6433 expref: 15 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249675:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97680204aa00/0x2774d8f311dc643a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6433 expref: 15 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249688:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97680204aa00/0x2774d8f311dc643a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6433 expref: 15 pid: 6491 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249699:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249717:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789061789.249731:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007160002s 00010000:00010000:3.0:1789061789.249736:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249743:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249749:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249756:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249762:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789061789.249765:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249773:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249789:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.249800:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061789.249828:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:3620:x1875967130752768:12345-0@lo:103: Request processed in 333us (2839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061789.249833:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789061789.249884:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130752640:0@lo:103: 00010000:00010000:3.0:1789061789.251341:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.251355:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061789.251362:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031800/0x2774d8f311dc6544 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061789.258792:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130752768:0@lo:103: 00080000:10000000:3.0:1789061789.260056:0:8404:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789061789.260230:0:8404:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789061789.260424:0:8404:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789061789.260567:0:8404:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789061789.260836:0:8404:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789061789.261035:0:8404:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789061789.263023:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789061789.274121:0:8404:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789061789.274131:0:8404:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789061789.274168:0:8404:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789061789.274273:0:8404:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789061789.274355:0:8404:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789061789.274385:0:8404:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789061789.275240:0:8404:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789061789.275408:0:8404:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1789061789.354829:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130752896:0@lo:41: 00000100:00100000:3.0:1789061789.354895:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061789.355001:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130752896 00000100:00100000:1.0:1789061789.355009:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130752896 00000100:00100000:1.0:1789061789.355055:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789061789.355064:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130752896:12345-0@lo:41: 00000004:00000024:1.0:1789061789.355097:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789061789.355140:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130752896:12345-0@lo:41: Request processed in 77us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061789.355147:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789061789.355284:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130752896:0@lo:41: 00010000:00010000:3.0:1789061789.487436:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789061790.120140:0:8490:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789061790.120536:0:8490:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789061790.507180:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061791.532072:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061791.915819:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061791.915857:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130753024:0@lo:41: 00000100:00100000:2.0:1789061791.915962:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061791.916162:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130753024 00000100:00100000:3.0:1789061791.916172:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130753024 00000100:00100000:3.0:1789061791.916232:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789061791.916243:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130753024:12345-0@lo:41: 00000004:00000024:3.0:1789061791.916365:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1789061791.916442:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130753024:12345-0@lo:41: Request processed in 199us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061791.916462:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789061791.916584:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130753024:0@lo:41: 10000000:01000000:3.0:1789061792.298719:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789061792.298729:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767fb057800 from 30 10000000:01000000:3.0:1789061792.298735:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789061792.298796:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061792.298809:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061792.298824:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061792.298855:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4571180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130753152:0@lo:101: 00000100:00100000:3.0:1789061792.298957:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061792.299025:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.299108:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130753152 00000100:00100000:0.0:1789061792.299118:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130753152 00000100:00100000:0.0:1789061792.299246:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789061792.299258:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:6493:x1875967130753152:12345-0@lo:101: 00010000:00010000:0.0:1789061792.299277:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061792.299294:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc654b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.299340:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc654b expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.299351:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc654b expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.299361:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030400, rc 0) 00000100:00100000:0.0:1789061792.299415:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130753152:12345-0@lo:101: Request processed in 159us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.299422:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789061792.299544:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4571180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130753152:0@lo:101: 00010000:00010000:3.0:1789061792.299560:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6552 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061792.299571:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6552 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061792.299679:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4571180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130753280:0@lo:501: 00000100:00100000:3.0:1789061792.299707:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061792.299728:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.299783:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130753280 00000100:00100000:2.0:1789061792.299788:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130753280 00000100:00100000:2.0:1789061792.299820:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789061792.299826:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130753280:12345-0@lo:501: 00000100:00100000:2.0:1789061792.299974:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130753280:12345-0@lo:501: Request processed in 148us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.299982:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789061792.300108:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4571180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130753280:0@lo:501: 00000100:00100000:3.0:1789061792.300136:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4571180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130753408:0@lo:503: 00000100:00100000:3.0:1789061792.300194:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061792.300211:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.300302:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130753408 00000100:00100000:0.0:1789061792.300307:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130753408 00000100:00100000:0.0:1789061792.300341:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789061792.300348:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130753408:12345-0@lo:503: 00000100:00100000:0.0:1789061792.300437:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130753408:12345-0@lo:503: Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.300444:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789061792.300481:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4571180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130753408:0@lo:503: 00000100:00100000:0.0:1789061792.300753:0:8605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8605:1875967130753536:0@lo:502: 00000100:00100000:0.0:1789061792.300787:0:8605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.300805:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130753536 00000100:00100000:0.0:1789061792.300809:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130753536 00000100:00100000:0.0:1789061792.300825:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789061792.300831:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8605:x1875967130753536:12345-0@lo:502: 00000100:00100000:0.0:1789061792.300929:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8605:x1875967130753536:12345-0@lo:502: Request processed in 98us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.300944:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789061792.300972:0:8605:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.300983:0:8605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8605:1875967130753536:0@lo:502: 00000100:00100000:0.0:1789061792.301024:0:8605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8605:1875967130753664:0@lo:502: 00000100:00100000:0.0:1789061792.301052:0:8605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.301067:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130753664 00000100:00100000:0.0:1789061792.301070:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130753664 00000100:00100000:0.0:1789061792.301084:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789061792.301088:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8605:x1875967130753664:12345-0@lo:502: 00000100:00100000:0.0:1789061792.301135:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:8605:x1875967130753664:12345-0@lo:502: Request processed in 45us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.301141:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789061792.301174:0:8605:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.301183:0:8605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8605:1875967130753664:0@lo:502: 00000040:00080000:0.0:1789061792.301199:0:8605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789061792.301257:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789061792.301275:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789061792.301283:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6552 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.301294:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6552 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061792.301304:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789061792.301307:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767fb057800 from 5 10000000:01000000:0.0:1789061792.301309:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789061792.301335:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.301349:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.301359:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061792.301371:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130753792:0@lo:101: 00000100:00100000:0.0:1789061792.301397:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.301409:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.301421:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130753792 00000100:00100000:0.0:1789061792.301424:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130753792 00000100:00100000:0.0:1789061792.301439:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789061792.301444:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130753792:12345-0@lo:101: 00010000:00010000:0.0:1789061792.301453:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061792.301465:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6559 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.301486:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6559 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.301497:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6559 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.301506:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030800, rc 0) 00000100:00100000:0.0:1789061792.301533:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130753792:12345-0@lo:101: Request processed in 88us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.301538:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789061792.301565:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130753792:0@lo:101: 00010000:00010000:0.0:1789061792.301585:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6560 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.301595:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6560 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061792.301665:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130753920:0@lo:256: 00000100:00100000:0.0:1789061792.301695:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.301707:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.301717:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130753920 00000100:00100000:0.0:1789061792.301720:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130753920 00000100:00100000:0.0:1789061792.301734:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789061792.301738:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130753920:12345-0@lo:256: 20000000:01000000:0.0:1789061792.301750:0:6488:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789061792.301768:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789061792.301771:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789061792.301849:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130753920:12345-0@lo:256: Request processed in 109us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.301855:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789061792.301893:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130753920:0@lo:256: 10000000:01000000:0.0:1789061792.301936:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789061792.301941:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6560 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.301949:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6560 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061792.301957:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789061792.301964:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1789061792.301967:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789061792.301982:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.301988:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.301996:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061792.302007:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130754048:0@lo:101: 00000100:00100000:0.0:1789061792.302030:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.302043:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.302053:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130754048 00000100:00100000:0.0:1789061792.302056:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130754048 00000100:00100000:0.0:1789061792.302071:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789061792.302076:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130754048:12345-0@lo:101: 00010000:00010000:0.0:1789061792.302082:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061792.302090:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc656e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6567 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.302103:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc656e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6567 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.302111:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc656e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6567 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.302118:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030c00, rc 0) 00000100:00100000:0.0:1789061792.302140:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130754048:12345-0@lo:101: Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.302151:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789061792.302176:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130754048:0@lo:101: 00010000:00010000:0.0:1789061792.302185:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc656e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.302192:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc656e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061792.302233:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130754176:0@lo:501: 00000100:00100000:0.0:1789061792.302254:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.302265:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.302275:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130754176 00000100:00100000:0.0:1789061792.302277:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130754176 00000100:00100000:0.0:1789061792.302291:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789061792.302296:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130754176:12345-0@lo:501: 00000100:00100000:0.0:1789061792.302404:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130754176:12345-0@lo:501: Request processed in 108us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.302412:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789061792.302434:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130754176:0@lo:501: 00000100:00100000:0.0:1789061792.302456:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130754304:0@lo:503: 00000100:00100000:0.0:1789061792.302490:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.302504:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.302514:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130754304 00000100:00100000:0.0:1789061792.302518:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130754304 00000100:00100000:0.0:1789061792.302533:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789061792.302538:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130754304:12345-0@lo:503: 00000100:00100000:0.0:1789061792.302646:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130754304:12345-0@lo:503: Request processed in 107us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.302653:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789061792.302690:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130754304:0@lo:503: 00000100:00100000:2.0:1789061792.305103:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8606:1875967130754432:0@lo:502: 00000100:00100000:2.0:1789061792.305215:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.305262:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd526cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061792.307085:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130754432 00000100:00100000:3.0:1789061792.307102:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130754432 00000100:00100000:3.0:1789061792.307182:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789061792.307195:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:8606:x1875967130754432:12345-0@lo:502: 00000100:00100000:3.0:1789061792.307402:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:8606:x1875967130754432:12345-0@lo:502: Request processed in 209us (2187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061792.307411:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789061792.308111:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8606:1875967130754432:0@lo:502: 00000020:01000000:2.0:1789061792.308173:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789061792.308184:0:8606:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789061792.308194:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061792.308197:0:8606:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789061792.308205:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789061792.308209:0:8606:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:2.0:1789061792.308240:0:8606:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789061792.308244:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789061792.308265:0:8606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9767fb32b380) 00000020:00000080:2.0:1789061792.308297:0:8606:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1789061792.308304:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789061792.308437:0:8606:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789061792.308445:0:8606:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789061792.308453:0:8606:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2774d8f311dc657c 00010000:00080000:2.0:1789061792.308500:0:8606:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767fb139000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1789061792.308810:0:8606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789061792.329365:0:8606:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789061792.329401:0:8606:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789061792.329727:0:8606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061792.329995:0:8606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061792.330108:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789061792.330186:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789061792.331984:0:8607:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789061792.331992:0:8607:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789061792.342720:0:8606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789061792.342745:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789061792.342816:0:8606:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789061792.342852:0:8606:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc6583 00000100:00080000:1.0:1789061792.342867:0:8606:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789061792.342894:0:8606:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9767fb139000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789061792.342949:0:8606:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9767f7ecf100 x1875967130754560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789061792.342989:0:8606:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789061792.343078:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061792.343083:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061792.343085:0:8606:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789061792.343088:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061792.343093:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061792.343094:0:8606:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789061792.343097:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789061792.343099:0:8606:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789061792.343133:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8606:1875967130754688:0@lo:502: 00000100:00100000:1.0:1789061792.343237:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061792.343403:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130754560:0@lo:8: 00000100:00100000:0.0:1789061792.343591:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130754816:0@lo:400: 00000100:00100000:1.0:1789061792.343693:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd4350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061792.344870:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130755200:0@lo:400: 00000100:00100000:3.0:1789061792.345269:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061792.345355:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130754688 00000100:00100000:3.0:1789061792.345364:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130754688 00000100:00100000:3.0:1789061792.345421:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789061792.345432:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:8606:x1875967130754688:12345-0@lo:502: 00000100:00100000:3.0:1789061792.345641:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:8606:x1875967130754688:12345-0@lo:502: Request processed in 211us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061792.345650:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789061792.345850:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130754560 00000100:00100000:2.0:1789061792.345862:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130754560 00000100:00100000:2.0:1789061792.345904:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789061792.345910:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875967130754560:12345-0@lo:8: 00010000:00080000:2.0:1789061792.345938:0:8411:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1789061792.345974:0:8411:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc658a 00002000:00100000:2.0:1789061792.346021:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9767fb139800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789061792.346026:0:8411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1789061792.346031:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789061792.346116:0:8411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789061792.346364:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789061792.346394:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9767fb138000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061792.346451:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1875967130754560:12345-0@lo:8: Request processed in 540us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.346458:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789061792.346517:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f7ecf100 x1875967130754560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789061802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061792.346529:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789061792.346539:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789061792.346549:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789061792.346554:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789061792.346557:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fb139000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789061792.346570:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789061792.346576:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130754560:0@lo:8: 00000004:00080000:2.0:1789061792.346625:0:8607:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789061792.346686:0:8607:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 173456079767ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789061792.346693:0:8607:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789061792.347360:0:8608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8608:1875967130755456:0@lo:700: 00000100:00100000:3.0:1789061792.347411:0:8608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061792.347450:0:8608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.347713:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130755456 00000100:00100000:2.0:1789061792.347744:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130755456 00000100:00100000:2.0:1789061792.347799:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789061792.347809:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8608:x1875967130755456:12345-0@lo:700: 00000100:00100000:2.0:1789061792.347847:0:8419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8419:1875967130755584:0@lo:700: 00000100:00100000:2.0:1789061792.347901:0:8419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.347920:0:8419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd526480 going to sleep for 11 seconds 00000100:00080000:3.0:1789061792.347989:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061792.348011:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130755584 00000100:00100000:3.0:1789061792.348015:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130755584 00000100:00100000:3.0:1789061792.348053:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061792.348060:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8419:x1875967130755584:12345-0@lo:700: 00000100:00080000:2.0:1789061792.348526:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061792.349119:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.349176:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130755328:0@lo:400: 00000100:00100000:0.0:1789061792.349216:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.349272:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130754944:0@lo:400: 00000100:00100000:0.0:1789061792.349299:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.349322:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061792.349330:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130755072:0@lo:400: 00000100:00100000:0.0:1789061792.349358:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.349397:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130754816 00000100:00100000:0.0:1789061792.349403:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130754816 00000100:00100000:0.0:1789061792.349444:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130755328 00000100:00100000:0.0:1789061792.349448:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130755328 00000100:00100000:0.0:1789061792.349471:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130754944 00000100:00100000:0.0:1789061792.349474:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130754944 00000100:00100000:0.0:1789061792.349490:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789061792.349497:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130754816:12345-0@lo:400: 00000100:00100000:0.0:1789061792.349550:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130754816:12345-0@lo:400: Request processed in 52us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.349558:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789061792.349577:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789061792.349583:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130755328:12345-0@lo:400: 00000100:00100000:0.0:1789061792.349653:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130755328:12345-0@lo:400: Request processed in 70us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.349660:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789061792.349673:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789061792.349679:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130754944:12345-0@lo:400: 00000100:00100000:0.0:1789061792.349712:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130754944:12345-0@lo:400: Request processed in 33us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.349717:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789061792.349737:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130755072 00000100:00100000:0.0:1789061792.349741:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130755072 00000100:00100000:0.0:1789061792.349769:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789061792.349776:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130755072:12345-0@lo:400: 00000100:00100000:0.0:1789061792.349809:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130755072:12345-0@lo:400: Request processed in 34us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.349816:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789061792.349850:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789061792.349895:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130755072:0@lo:400: 00010000:00080000:0.0:1789061792.349912:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f4506a00 x1875967130754944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061792.349924:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130754944:0@lo:400: 00010000:00080000:0.0:1789061792.349958:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f4506300 x1875967130754816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061792.349967:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130754816:0@lo:400: 00010000:00080000:0.0:1789061792.349978:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f4504000 x1875967130755328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061792.350000:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130755328:0@lo:400: 00000004:00080000:3.0:1789061792.350915:0:7427:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789061792.351225:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061792.351501:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8606:1875967130754688:0@lo:502: 00000020:01000000:1.0:1789061792.351554:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061792.351564:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061792.351566:0:8606:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789061792.351576:0:8606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1789061792.351930:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1789061792.351957:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789061792.351970:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc656e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.351984:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc656e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061792.351996:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789061792.351999:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767c3163000 from 30 10000000:01000000:2.0:1789061792.352002:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789061792.352040:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.352049:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.352060:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061792.352079:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130755712:0@lo:101: 00000100:00100000:2.0:1789061792.352140:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.352175:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd526d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061792.352288:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130755712 00000100:00100000:3.0:1789061792.352296:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130755712 00000100:00100000:3.0:1789061792.352345:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789061792.352355:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130755712:12345-0@lo:101: 00010000:00010000:3.0:1789061792.352369:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061792.352384:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6591 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061792.352412:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6591 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061792.352424:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6591 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061792.352433:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3799c00, rc 0) 00000100:00100000:3.0:1789061792.352468:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130755712:12345-0@lo:101: Request processed in 115us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061792.352475:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789061792.352635:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130755712:0@lo:101: 00010000:00010000:2.0:1789061792.352650:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6598 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.352661:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6598 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061792.352725:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130755840:0@lo:501: 00000100:00100000:2.0:1789061792.352763:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.352785:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd526d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061792.353331:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130755840 00000100:00100000:3.0:1789061792.353338:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130755840 00000100:00100000:3.0:1789061792.353380:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789061792.353388:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130755840:12345-0@lo:501: 00000100:00100000:3.0:1789061792.353542:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130755840:12345-0@lo:501: Request processed in 155us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061792.353561:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789061792.353650:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130755840:0@lo:501: 00000100:00100000:2.0:1789061792.353685:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130755968:0@lo:503: 00000100:00100000:2.0:1789061792.353726:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.353754:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd526d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061792.353801:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130755968 00000100:00100000:3.0:1789061792.353805:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130755968 00000100:00100000:3.0:1789061792.354355:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789061792.354365:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130755968:12345-0@lo:503: 00000100:00100000:3.0:1789061792.354477:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130755968:12345-0@lo:503: Request processed in 114us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061792.354484:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789061792.354600:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130755200 00000100:00100000:0.0:1789061792.354627:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130755200 00000100:00100000:0.0:1789061792.354671:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789061792.354679:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3622:x1875967130755200:12345-0@lo:400: 00000100:00100000:0.0:1789061792.354725:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3622:x1875967130755200:12345-0@lo:400: Request processed in 47us (3501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.354730:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789061792.354868:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f4504a80 x1875967130755200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061792.354906:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130755200:0@lo:400: 40000000:02000000:0.0:1789061792.355580:0:6503:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1789061792.363170:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130755968:0@lo:503: 00000100:00100000:2.0:1789061792.363586:0:8609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8609:1875967130756096:0@lo:502: 00000100:00100000:2.0:1789061792.363695:0:8609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.363741:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130756096 00000100:00100000:2.0:1789061792.363748:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130756096 00000100:00100000:2.0:1789061792.363797:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789061792.363807:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:8609:x1875967130756096:12345-0@lo:502: 00000100:00100000:2.0:1789061792.363965:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:8609:x1875967130756096:12345-0@lo:502: Request processed in 159us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.363974:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789061792.364035:0:8609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd526540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.364057:0:8609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8609:1875967130756096:0@lo:502: 00000100:00100000:2.0:1789061792.364102:0:8609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8609:1875967130756224:0@lo:502: 00000100:00100000:2.0:1789061792.364135:0:8609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.364154:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130756224 00000100:00100000:2.0:1789061792.364158:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130756224 00000100:00100000:2.0:1789061792.364178:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789061792.364185:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:8609:x1875967130756224:12345-0@lo:502: 00000100:00100000:2.0:1789061792.364245:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:8609:x1875967130756224:12345-0@lo:502: Request processed in 60us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.364252:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789061792.364282:0:8609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd526540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.364295:0:8609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8609:1875967130756224:0@lo:502: 00000040:00080000:2.0:1789061792.364313:0:8609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789061792.364380:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789061792.364405:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789061792.364416:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6598 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.364429:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6598 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061792.364440:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789061792.364443:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767c3163000 from 5 10000000:01000000:2.0:1789061792.364447:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789061792.364474:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.364483:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.364501:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061792.364513:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130756352:0@lo:101: 00000100:00100000:2.0:1789061792.364543:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.364557:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd526540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.364570:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130756352 00000100:00100000:2.0:1789061792.364574:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130756352 00000100:00100000:2.0:1789061792.364594:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789061792.364600:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130756352:12345-0@lo:101: 00010000:00010000:2.0:1789061792.364638:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061792.364653:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c1483c00/0x2774d8f311dc65a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc659f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.364678:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1483c00/0x2774d8f311dc65a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc659f expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.364690:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c1483c00/0x2774d8f311dc65a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc659f expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.364701:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c1483c00, rc 0) 00000100:00100000:2.0:1789061792.364729:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130756352:12345-0@lo:101: Request processed in 129us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.364736:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789061792.364768:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130756352:0@lo:101: 00010000:00010000:2.0:1789061792.364780:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc65a6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.364800:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc65a6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061792.364846:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130756480:0@lo:256: 00000100:00100000:2.0:1789061792.364903:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.364917:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd526540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.364928:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130756480 00000100:00100000:2.0:1789061792.364932:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130756480 00000100:00100000:2.0:1789061792.364952:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789061792.364958:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130756480:12345-0@lo:256: 20000000:01000000:2.0:1789061792.364973:0:6488:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789061792.364994:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789061792.364998:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789061792.365069:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130756480:12345-0@lo:256: Request processed in 110us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.365076:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789061792.365105:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130756480:0@lo:256: 10000000:01000000:2.0:1789061792.365148:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789061792.365154:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc65a6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.365162:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc65a6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061792.365169:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789061792.365171:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789061792.365173:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789061792.365194:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.365201:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.365208:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061792.365219:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130756608:0@lo:101: 00000100:00100000:2.0:1789061792.365242:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.365254:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd526540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.365265:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130756608 00000100:00100000:2.0:1789061792.365268:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130756608 00000100:00100000:2.0:1789061792.365286:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789061792.365292:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130756608:12345-0@lo:101: 00010000:00010000:2.0:1789061792.365299:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061792.365307:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc65b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc65ad expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.365322:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc65b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc65ad expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.365331:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc65b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc65ad expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.365338:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c1482c00, rc 0) 00000100:00100000:2.0:1789061792.365363:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130756608:12345-0@lo:101: Request processed in 71us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.365369:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789061792.365407:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130756608:0@lo:101: 00010000:00010000:2.0:1789061792.365418:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc65b4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.365426:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc65b4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061792.365474:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130756736:0@lo:501: 00000100:00100000:2.0:1789061792.365498:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.365510:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c15ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.365521:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130756736 00000100:00100000:2.0:1789061792.365525:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130756736 00000100:00100000:2.0:1789061792.365543:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789061792.365549:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130756736:12345-0@lo:501: 00000100:00100000:2.0:1789061792.365695:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130756736:12345-0@lo:501: Request processed in 145us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.365701:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789061792.365730:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130756736:0@lo:501: 00000100:00100000:2.0:1789061792.365755:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130756864:0@lo:503: 00000100:00100000:2.0:1789061792.365794:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.365805:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c15ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.365815:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130756864 00000100:00100000:2.0:1789061792.365818:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130756864 00000100:00100000:2.0:1789061792.365834:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789061792.365840:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130756864:12345-0@lo:503: 00000100:00100000:2.0:1789061792.367993:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130756864:12345-0@lo:503: Request processed in 2144us (2190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.368025:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789061792.368542:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8419:x1875967130755584:12345-0@lo:700: Request processed in 20480us (20637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.368553:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789061792.368724:0:8419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c56fe300 x1875967130755584/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789061808 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061792.368742:0:8419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8419:1875967130755584:0@lo:700: 40000000:02000000:2.0:1789061792.368758:0:8419:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1789061792.368995:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130756864:0@lo:503: 00000100:00100000:3.0:1789061792.370233:0:8610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8610:1875967130756992:0@lo:502: 00000100:00100000:3.0:1789061792.370320:0:8610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061792.370406:0:8610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.370446:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130756992 00000100:00100000:0.0:1789061792.370456:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130756992 00000100:00100000:0.0:1789061792.370541:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789061792.370552:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:8610:x1875967130756992:12345-0@lo:502: 00000100:00100000:0.0:1789061792.370849:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:8610:x1875967130756992:12345-0@lo:502: Request processed in 297us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.370857:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789061792.370978:0:8610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8610:1875967130756992:0@lo:502: 00000020:01000000:1.0:1789061792.371013:0:8610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789061792.371023:0:8610:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789061792.371033:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061792.371036:0:8610:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789061792.371046:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789061792.371051:0:8610:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:1.0:1789061792.371081:0:8610:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789061792.371084:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789061792.371103:0:8610:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9767f7e58000) 00000020:00000080:1.0:1789061792.371133:0:8610:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1789061792.371139:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789061792.371235:0:8610:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789061792.371242:0:8610:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789061792.371251:0:8610:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc65c2 00010000:00080000:1.0:1789061792.371285:0:8610:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9766c1585000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1789061792.371560:0:8610:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:3.0:1789061792.374437:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789061792.374853:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8608:x1875967130755456:12345-0@lo:700: Request processed in 27039us (27434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.374870:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789061792.374972:0:8608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd515c00 x1875967130755456/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789061808 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061792.374992:0:8608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8608:1875967130755456:0@lo:700: 00000004:00080000:0.0:1789061792.383252:0:8608:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789061792.383308:0:8608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8608:1875967130757248:0@lo:7: 00000100:00100000:0.0:1789061792.383403:0:8608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.383454:0:8608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.383474:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061792.383489:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130757120:0@lo:13: 00000100:00100000:0.0:1789061792.383534:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.383574:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130757120 00000100:00100000:0.0:1789061792.383583:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130757120 00000100:00100000:3.0:1789061792.383775:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130757248 00000100:00100000:3.0:1789061792.383780:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130757248 00000100:00100000:3.0:1789061792.383824:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061792.383835:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8608:x1875967130757248:12345-0@lo:7: 00000100:00100000:0.0:1789061792.386027:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789061792.386048:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875967130757120:12345-0@lo:13: 00002000:00000024:0.0:1789061792.386081:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923906560 avail 3692384256 00000100:00100000:0.0:1789061792.386179:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875967130757120:12345-0@lo:13: Request processed in 142us (2643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061792.386187:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789061792.386257:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f38b7800 x1875967130757120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061792.386282:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130757120:0@lo:13: 00000040:01000000:1.0:1789061792.386518:0:8610:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789061792.386543:0:8610:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789061792.389072:0:8610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789061792.389365:0:8610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789061792.389474:0:8610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789061792.389568:0:8610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789061792.392460:0:8611:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061792.392470:0:8611:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789061792.397051:0:8610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789061792.397067:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789061792.397110:0:8610:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789061792.397136:0:8610:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc65c9 00000100:00080000:0.0:1789061792.397147:0:8610:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789061792.397159:0:8610:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9766c1585000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1789061792.397199:0:8610:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9767f38b7800 x1875967130757376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789061792.397230:0:8610:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789061792.397347:0:8610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789061792.397353:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061792.397355:0:8610:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789061792.397361:0:8610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789061792.397374:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789061792.397376:0:8610:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789061792.397387:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789061792.397389:0:8610:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789061792.397423:0:8610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4504a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8610:1875967130757504:0@lo:502: 00000100:00100000:0.0:1789061792.397514:0:8610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.397566:0:8610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.398728:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130757376:0@lo:8: 00000100:00100000:2.0:1789061792.398831:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.398939:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130757504 00000100:00100000:2.0:1789061792.398949:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130757504 00000100:00100000:2.0:1789061792.399006:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789061792.399016:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:8610:x1875967130757504:12345-0@lo:502: 00000100:00100000:2.0:1789061792.399175:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:8610:x1875967130757504:12345-0@lo:502: Request processed in 160us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.399183:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789061792.399253:0:8610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4504a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:8610:1875967130757504:0@lo:502: 00000100:00100000:0.0:1789061792.399420:0:8412:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789061792.399430:0:8412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000020:01000000:2.0:1789061792.399721:0:8610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061792.399730:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061792.399732:0:8610:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789061792.399739:0:8610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00080000:3.0:1789061792.400998:0:8413:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789061792.401009:0:8413:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789061792.401106:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8608:x1875967130757248:12345-0@lo:7: Request processed in 17268us (17699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061792.401117:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061792.401157:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130757376 00000100:00100000:3.0:1789061792.401166:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130757376 00000100:00100000:3.0:1789061792.401202:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061792.401209:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875967130757376:12345-0@lo:8: 00010000:00080000:3.0:1789061792.401243:0:8413:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:3.0:1789061792.401278:0:8413:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc65d0 00002000:00100000:3.0:1789061792.401295:0:8413:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9767fd2c1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789061792.401301:0:8413:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789061792.401305:0:8413:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789061792.401348:0:8413:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789061792.401381:0:8413:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061792.401429:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1875967130757376:12345-0@lo:8: Request processed in 218us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061792.401436:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789061792.404010:0:8608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f38b7b80 x1875967130757248/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789061808 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061792.404031:0:8608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8608:1875967130757248:0@lo:7: 00000004:00080000:1.0:1789061792.404050:0:8608:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789061792.404101:0:8608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8608:1875967130757632:0@lo:5: 00000100:00100000:1.0:1789061792.404165:0:8608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061792.404225:0:8608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d02e7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.404401:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130757632 00000100:00100000:2.0:1789061792.404409:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130757632 00000100:00100000:2.0:1789061792.404456:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789061792.404465:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8608:x1875967130757632:12345-0@lo:5: 00002000:00080000:2.0:1789061792.404494:0:8413:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789061792.404545:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8608:x1875967130757632:12345-0@lo:5: Request processed in 81us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.404553:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789061792.404661:0:8608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f7ecca80 x1875967130757632/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789061808 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061792.404670:0:8608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8608:1875967130757632:0@lo:5: 00000004:00080000:1.0:1789061792.404679:0:8608:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789061792.404705:0:8608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8608:1875967130757760:0@lo:5: 00000100:00100000:1.0:1789061792.404729:0:8608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061792.406157:0:8608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d02e7cc0 going to sleep for 11 seconds 00000020:01000000:0.0:1789061792.406271:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789061792.406317:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789061792.406332:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc65b4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.406346:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc65b4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061792.406361:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789061792.406364:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9767f38a8000 from 1 10000000:01000000:0.0:1789061792.406367:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789061792.406414:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.406424:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061792.406435:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061792.406457:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4504000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130757888:0@lo:101: 00000100:00100000:0.0:1789061792.406526:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.406591:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d117f180 going to sleep for 11 seconds 00010000:00080000:0.0:1789061792.406705:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f38b7800 x1875967130757376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789061802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061792.406717:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789061792.406728:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789061792.406738:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789061792.406745:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789061792.406749:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9766c1585000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789061792.406766:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789061792.406891:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130757888 00000100:00100000:1.0:1789061792.406899:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130757888 00000100:00100000:1.0:1789061792.406950:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789061792.406959:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130757888:12345-0@lo:101: 00010000:00010000:1.0:1789061792.406974:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061792.406989:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47ae00/0x2774d8f311dc65de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc65d7 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061792.407017:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47ae00/0x2774d8f311dc65de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc65d7 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061792.407030:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47ae00/0x2774d8f311dc65de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc65d7 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061792.407039:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47ae00, rc 0) 00000100:00100000:1.0:1789061792.407082:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130757888:12345-0@lo:101: Request processed in 125us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061792.407089:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789061792.407132:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4504000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130757888:0@lo:101: 00010000:00010000:1.0:1789061792.407159:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc65de expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061792.407168:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc65de expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061792.407234:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130758016:0@lo:501: 00000100:00100000:1.0:1789061792.407262:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061792.407281:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d02e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.407496:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130757376:0@lo:8: 00000100:00100000:2.0:1789061792.410461:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130757760 00000100:00100000:2.0:1789061792.410480:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130757760 00000100:00100000:2.0:1789061792.410501:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130758016 00000100:00100000:2.0:1789061792.410506:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130758016 00000100:00100000:2.0:1789061792.410563:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789061792.410574:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130758016:12345-0@lo:501: 00000100:00100000:2.0:1789061792.413152:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130758016:12345-0@lo:501: Request processed in 196us (3505us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789061792.413179:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789061792.413662:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130758016:0@lo:501: 10000000:01000000:2.0:1789061792.413719:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789061792.413732:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc65de expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061792.413746:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc65de expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789061792.414377:0:8611:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789061792.414566:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789061792.414579:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8608:x1875967130757760:12345-0@lo:5: 00002000:00080000:2.0:1789061792.414654:0:8413:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000004:00080000:1.0:1789061792.417873:0:8611:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173527262604ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789061792.417896:0:8611:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789061792.425225:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8608:x1875967130757760:12345-0@lo:5: Request processed in 10636us (20482us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789061792.425240:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789061792.425501:0:8608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f7ecca80 x1875967130757760/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789061808 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061792.425522:0:8608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8608:1875967130757760:0@lo:5: 00000004:00080000:3.0:1789061792.425543:0:8608:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1789061792.425600:0:8608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8608:1875967130758144:0@lo:900: 00000100:00100000:3.0:1789061792.425691:0:8608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061792.425738:0:8608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.426089:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130758144 00000100:00100000:2.0:1789061792.426099:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130758144 00000100:00100000:2.0:1789061792.426152:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789061792.426162:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8608:x1875967130758144:12345-0@lo:900: 00000100:00100000:2.0:1789061792.426227:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8608:x1875967130758144:12345-0@lo:900: Request processed in 65us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.426234:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789061792.426643:0:8608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd515c00 x1875967130758144/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789061808 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061792.426656:0:8608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8608:1875967130758144:0@lo:900: 00000004:00080000:3.0:1789061792.428991:0:8612:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789061792.429036:0:8612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875967130758400:0@lo:7: 00000100:00100000:3.0:1789061792.429123:0:8612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061792.429172:0:8612:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061792.429426:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061792.429441:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130758272:0@lo:13: 00000100:00100000:2.0:1789061792.429478:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.429522:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130758400 00000100:00100000:2.0:1789061792.429530:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130758400 00000100:00100000:2.0:1789061792.429597:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789061792.429626:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8612:x1875967130758400:12345-0@lo:7: 00000100:00100000:3.0:1789061792.435246:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130758272 00000100:00100000:3.0:1789061792.435277:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130758272 00000100:00100000:3.0:1789061792.435355:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789061792.435369:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875967130758272:12345-0@lo:13: 00002000:00000024:3.0:1789061792.435404:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1789061792.435520:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875967130758272:12345-0@lo:13: Request processed in 154us (6040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061792.435527:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:1.0:1789061792.436448:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:0.0:1789061792.438480:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd515c00 x1875967130758272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061792.438517:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130758272:0@lo:13: 00000100:00080000:3.0:1789061792.438646:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1789061792.439366:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789061792.439375:0:8412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789061792.439559:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd514380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8612:x1875967130758400:12345-0@lo:7: Request processed in 9949us (10432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061792.439570:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789061792.439945:0:8612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd517b80 x1875967130758400/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789061808 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061792.439962:0:8612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875967130758400:0@lo:7: 00000004:00080000:3.0:1789061792.439977:0:8612:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789061792.440098:0:8612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56ff800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875967130758528:0@lo:5: 00000100:00100000:2.0:1789061792.440145:0:8612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061792.440213:0:8612:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd594180 going to sleep for 11 seconds 00000100:00100000:0.0:1789061792.440245:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130758528 00000100:00100000:0.0:1789061792.440254:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130758528 00000100:00100000:0.0:1789061792.440399:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789061792.440410:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8612:x1875967130758528:12345-0@lo:5: 00002000:00080000:0.0:1789061792.440443:0:8411:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789061792.440447:0:8411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1789061792.451125:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1789061792.451150:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789061792.451156:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789061792.453926:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8612:x1875967130758528:12345-0@lo:5: Request processed in 13505us (13768us total) trans 4294967298 rc 0/0 00010000:00080000:3.0:1789061792.453946:0:8612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c56ff800 x1875967130758528/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789061808 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061792.453948:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789061792.453960:0:8612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789061792.453967:0:8612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56ff800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875967130758528:0@lo:5: 00000004:00080000:3.0:1789061792.453986:0:8612:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789061792.454050:0:8612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875967130758656:0@lo:700: 00000100:00100000:3.0:1789061792.454092:0:8612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061792.454141:0:8612:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061792.454208:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130758656 00000100:00100000:1.0:1789061792.454216:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130758656 00000100:00100000:1.0:1789061792.454276:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789061792.454285:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8612:x1875967130758656:12345-0@lo:700: 00000100:00100000:1.0:1789061792.463360:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8612:x1875967130758656:12345-0@lo:700: Request processed in 9060us (9251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061792.463380:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789061792.463473:0:8612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd517b80 x1875967130758656/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789061808 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061792.463508:0:8612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875967130758656:0@lo:700: 00000004:02000040:0.0:1789061792.465486:0:8612:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1789061792.470694:0:8612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875967130758784:0@lo:5: 00000100:00100000:0.0:1789061792.471248:0:8612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061792.471422:0:8612:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd427600 going to sleep for 11 seconds 00000100:00100000:3.0:1789061792.471493:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130758784 00000100:00100000:3.0:1789061792.471503:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130758784 00000100:00100000:3.0:1789061792.471632:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789061792.471644:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8612:x1875967130758784:12345-0@lo:5: 00002000:00080000:0.0:1789061792.476937:0:8613:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789061792.476971:0:8613:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1789061792.484869:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8612:x1875967130758784:12345-0@lo:5: Request processed in 13217us (13610us total) trans 4294967299 rc 0/0 00010000:00080000:2.0:1789061792.485102:0:8612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f4506300 x1875967130758784/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789061808 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061792.485125:0:8612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875967130758784:0@lo:5: 00000004:00080000:2.0:1789061792.485155:0:8612:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:0.0:1789061792.488493:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789061792.555961:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061793.581075:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061794.474171:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061794.474195:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130758912:0@lo:41: 00000100:00100000:1.0:1789061794.474263:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061794.474332:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130758912 00000100:00100000:1.0:1789061794.474352:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130758912 00000100:00100000:1.0:1789061794.474399:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789061794.474408:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130758912:12345-0@lo:41: 00000004:00000024:1.0:1789061794.474441:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789061794.474488:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130758912:12345-0@lo:41: Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061794.474494:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789061794.474540:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130758912:0@lo:41: 00010000:00010000:0.0:1789061794.605222:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789061795.334344:0:8788:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789061795.625737:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789061796.334380:0:8840:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789061796.337517:0:8840:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789061796.652270:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061797.034811:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061797.034834:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130759040:0@lo:41: 00000100:00100000:3.0:1789061797.034906:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061797.034967:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130759040 00000100:00100000:3.0:1789061797.034974:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130759040 00000100:00100000:3.0:1789061797.035013:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789061797.035021:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130759040:12345-0@lo:41: 00000004:00000024:3.0:1789061797.035056:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789061797.035250:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130759040:12345-0@lo:41: Request processed in 227us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061797.035257:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789061797.043537:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130759040:0@lo:41: 00000001:00080000:1.0:1789061797.384388:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1789061797.545830:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061797.545870:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130759168:0@lo:13: 00000100:00100000:0.0:1789061797.545939:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061797.546126:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130759168 00000100:00100000:3.0:1789061797.546134:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130759168 00000100:00100000:3.0:1789061797.546205:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789061797.546217:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130759168:12345-0@lo:13: 00002000:00000024:3.0:1789061797.546260:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061797.546309:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130759168:12345-0@lo:13: Request processed in 95us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061797.546317:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789061797.546358:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f4507100 x1875967130759168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061797.546388:0:3621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789061797.546408:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130759168:0@lo:13: 00000100:00100000:3.0:1789061797.546505:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130759424:0@lo:400: 00000100:00100000:3.0:1789061797.546534:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061797.546553:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130759936:0@lo:400: 00000100:00100000:3.0:1789061797.546572:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061797.546591:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789061797.546597:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130759552:0@lo:400: 00000100:00100000:3.0:1789061797.546641:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061797.546659:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130760064:0@lo:400: 00000100:00100000:3.0:1789061797.546679:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061797.546704:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130759424 00000100:00100000:3.0:1789061797.546708:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130759424 00000100:00100000:3.0:1789061797.546733:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130759936 00000100:00100000:3.0:1789061797.546736:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130759936 00000100:00100000:3.0:1789061797.546749:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130759552 00000100:00100000:3.0:1789061797.546751:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130759552 00000100:00100000:3.0:1789061797.546763:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789061797.546769:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130759424:12345-0@lo:400: 00000100:00100000:3.0:1789061797.546806:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130759424:12345-0@lo:400: Request processed in 37us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061797.546812:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789061797.546824:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789061797.546830:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130759936:12345-0@lo:400: 00000100:00100000:3.0:1789061797.546869:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130759936:12345-0@lo:400: Request processed in 39us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061797.546882:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789061797.546896:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789061797.546902:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130759552:12345-0@lo:400: 00000100:00100000:3.0:1789061797.546931:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130759552:12345-0@lo:400: Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061797.546936:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789061797.546962:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130759680:0@lo:400: 00000100:00100000:3.0:1789061797.546987:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061797.547007:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789061797.547012:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130759296:0@lo:400: 00000100:00100000:3.0:1789061797.547038:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061797.547058:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130759808:0@lo:400: 00000100:00100000:3.0:1789061797.547079:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061797.547102:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130759680 00000100:00100000:3.0:1789061797.547106:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130759680 00000100:00100000:3.0:1789061797.547130:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789061797.547136:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130759680:12345-0@lo:400: 00000100:00100000:3.0:1789061797.547187:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130759680:12345-0@lo:400: Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061797.547193:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789061797.547225:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130759680:0@lo:400: 00010000:00080000:3.0:1789061797.547248:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd515880 x1875967130759552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061797.547258:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130759552:0@lo:400: 00010000:00080000:3.0:1789061797.547267:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd515500 x1875967130759424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061797.547281:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130759424:0@lo:400: 00010000:00080000:3.0:1789061797.547292:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd514a80 x1875967130759936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061797.547299:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130759936:0@lo:400: 00000100:00100000:3.0:1789061797.547314:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130759808 00000100:00100000:3.0:1789061797.547317:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130759808 00000100:00100000:3.0:1789061797.547338:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789061797.547344:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130759808:12345-0@lo:400: 00000100:00100000:3.0:1789061797.547374:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130759808:12345-0@lo:400: Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061797.547380:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789061797.547404:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd515f80 x1875967130759808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061797.547413:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130759808:0@lo:400: 00000100:00100000:1.0:1789061797.547501:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130759296 00000100:00100000:1.0:1789061797.547505:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130759296 00000100:00100000:1.0:1789061797.547540:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789061797.547547:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3620:x1875967130759296:12345-0@lo:400: 00000100:00100000:1.0:1789061797.547586:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3620:x1875967130759296:12345-0@lo:400: Request processed in 39us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061797.547592:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789061797.547644:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130759296:0@lo:400: 00000100:00100000:2.0:1789061797.547882:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130760064 00000100:00100000:2.0:1789061797.547887:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130760064 00000100:00100000:2.0:1789061797.547915:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789061797.547922:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130760064:12345-0@lo:400: 00000100:00100000:2.0:1789061797.547961:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130760064:12345-0@lo:400: Request processed in 40us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061797.547966:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789061797.547993:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd517100 x1875967130760064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061797.548001:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1789061797.548011:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130760064:0@lo:400: 00000100:00100000:2.0:1789061797.548025:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789061797.548032:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130760192:0@lo:13: 00000100:00100000:2.0:1789061797.548057:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061797.548085:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130760192 00000100:00100000:2.0:1789061797.548089:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130760192 00000100:00100000:2.0:1789061797.548109:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789061797.548115:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130760192:12345-0@lo:13: 00002000:00000024:2.0:1789061797.548128:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061797.548160:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130760192:12345-0@lo:13: Request processed in 45us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061797.548166:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789061797.548191:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c56ff800 x1875967130760192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061797.548218:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130760192:0@lo:13: 00000100:00080000:0.0:1789061797.548516:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061797.548521:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789061797.548523:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789061797.673885:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061798.698155:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789061799.281041:0:8942:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789061799.281255:0:8942:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789061799.599499:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061799.599528:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130760320:0@lo:41: 00000100:00100000:1.0:1789061799.599596:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061799.599685:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130760320 00000100:00100000:1.0:1789061799.599692:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130760320 00000100:00100000:1.0:1789061799.599749:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789061799.599758:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130760320:12345-0@lo:41: 00000004:00000024:1.0:1789061799.601752:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789061799.601986:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130760320:12345-0@lo:41: Request processed in 2225us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061799.601996:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789061799.602145:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130760320:0@lo:41: 00010000:00010000:2.0:1789061799.721839:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789061800.245687:0:8990:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789061800.245698:0:8990:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789061800.748442:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061801.770214:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061802.154032:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061802.154071:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130760448:0@lo:41: 00000100:00100000:1.0:1789061802.154179:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061802.154393:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130760448 00000100:00100000:3.0:1789061802.154404:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130760448 00000100:00100000:3.0:1789061802.154475:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789061802.154488:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130760448:12345-0@lo:41: 00000004:00000024:3.0:1789061802.154538:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789061802.154643:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130760448:12345-0@lo:41: Request processed in 157us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061802.154671:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789061802.154765:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130760448:0@lo:41: 00000100:00100000:1.0:1789061802.665866:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130760576:0@lo:13: 00000100:00100000:1.0:1789061802.665965:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061802.666108:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130760576 00000100:00100000:2.0:1789061802.666118:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130760576 00000100:00100000:2.0:1789061802.666212:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789061802.666225:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130760576:12345-0@lo:13: 00002000:00000024:2.0:1789061802.666264:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061802.666321:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130760576:12345-0@lo:13: Request processed in 99us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061802.666328:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789061802.666374:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c56ff800 x1875967130760576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061802.666395:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130760576:0@lo:13: 00000100:00080000:0.0:1789061802.667060:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061802.668272:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130760704:0@lo:13: 00000100:00100000:0.0:1789061802.668363:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061802.668440:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130760704 00000100:00100000:0.0:1789061802.668449:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130760704 00000100:00100000:0.0:1789061802.668507:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789061802.668517:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130760704:12345-0@lo:13: 00002000:00000024:0.0:1789061802.668541:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061802.668654:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130760704:12345-0@lo:13: Request processed in 138us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061802.668662:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789061802.668695:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789061802.668723:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f4504a80 x1875967130760704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061802.668742:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130760704:0@lo:13: 00000100:00100000:0.0:1789061802.671122:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130760960:0@lo:400: 00000100:00100000:1.0:1789061802.671264:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130761216:0@lo:400: 00000100:00100000:1.0:1789061802.671324:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061802.671367:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130760832:0@lo:400: 00000100:00100000:2.0:1789061802.671410:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061802.671448:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130761216 00000100:00100000:2.0:1789061802.671450:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130761344:0@lo:400: 00000100:00100000:1.0:1789061802.671458:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130761216 00000100:00100000:2.0:1789061802.671485:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061802.671513:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789061802.671523:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130761216:12345-0@lo:400: 00000100:00100000:2.0:1789061802.671531:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130760832 00000100:00100000:2.0:1789061802.671537:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130760832 00000100:00100000:2.0:1789061802.671576:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789061802.671586:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3621:x1875967130760832:12345-0@lo:400: 00000100:00100000:1.0:1789061802.671592:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130761216:12345-0@lo:400: Request processed in 69us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061802.671601:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789061802.671670:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130761216:0@lo:400: 00000100:00100000:2.0:1789061802.671680:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3621:x1875967130760832:12345-0@lo:400: Request processed in 95us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061802.671698:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789061802.671699:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061802.671730:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130761472:0@lo:400: 00000100:00100000:1.0:1789061802.671733:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130761344 00000100:00100000:1.0:1789061802.671738:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130761344 00000100:00100000:2.0:1789061802.671747:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130760960 00000100:00100000:2.0:1789061802.671752:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130760960 00000100:00100000:0.0:1789061802.671760:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061802.671784:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061802.671786:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130761472 00000100:00100000:1.0:1789061802.671791:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130761472 00000100:00100000:0.0:1789061802.671792:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130761088:0@lo:400: 00000100:00100000:2.0:1789061802.671795:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789061802.671804:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130761344:12345-0@lo:400: 00000100:00100000:1.0:1789061802.671833:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789061802.671842:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130760960:12345-0@lo:400: 00000100:00100000:0.0:1789061802.671847:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061802.671849:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130761344:12345-0@lo:400: Request processed in 47us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061802.671860:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789061802.671875:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130761088 00000100:00100000:2.0:1789061802.671880:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130761088 00000100:00100000:1.0:1789061802.671901:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130760960:12345-0@lo:400: Request processed in 60us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061802.671906:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789061802.671915:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789061802.671920:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130761472:12345-0@lo:400: 00000100:00100000:1.0:1789061802.671934:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789061802.671943:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130761088:12345-0@lo:400: 00000100:00100000:2.0:1789061802.671961:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130761472:12345-0@lo:400: Request processed in 45us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061802.671968:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789061802.671981:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130761088:12345-0@lo:400: Request processed in 38us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061802.671987:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789061802.672005:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130760832:0@lo:400: 00000100:00080000:1.0:1789061802.672010:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789061802.672015:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789061802.672022:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f38b7b80 x1875967130761344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061802.672033:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130761344:0@lo:400: 00010000:00080000:1.0:1789061802.672039:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f7ecdf80 x1875967130761088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061802.672050:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130761088:0@lo:400: 00010000:00080000:1.0:1789061802.672080:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd346a00 x1875967130761472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061802.672089:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130761472:0@lo:400: 00010000:00080000:1.0:1789061802.672103:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767f7ecca80 x1875967130760960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061802.672111:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130760960:0@lo:400: 00010000:00010000:3.0:1789061802.795363:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061803.818023:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061804.714646:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130761600:0@lo:41: 00000100:00100000:2.0:1789061804.714715:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061804.714931:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130761600 00000100:00100000:3.0:1789061804.714939:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130761600 00000100:00100000:3.0:1789061804.714982:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789061804.714991:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130761600:12345-0@lo:41: 00000004:00000024:3.0:1789061804.715027:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789061804.715136:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130761600:12345-0@lo:41: Request processed in 145us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061804.715144:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789061804.715309:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130761600:0@lo:41: 00010000:00010000:3.0:1789061804.849053:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061805.865838:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061806.889826:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061807.276895:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061807.276921:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130761728:0@lo:41: 00000100:00100000:3.0:1789061807.276986:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061807.277051:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130761728 00000100:00100000:3.0:1789061807.277058:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130761728 00000100:00100000:3.0:1789061807.277106:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789061807.277114:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130761728:12345-0@lo:41: 00000004:00000024:3.0:1789061807.277313:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789061807.277361:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130761728:12345-0@lo:41: Request processed in 247us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061807.277369:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789061807.277413:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130761728:0@lo:41: 00000100:00100000:3.0:1789061807.785770:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130761856:0@lo:13: 00000100:00100000:3.0:1789061807.785843:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061807.786023:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130761856 00000100:00100000:0.0:1789061807.786031:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130761856 00000100:00100000:0.0:1789061807.786090:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789061807.786099:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130761856:12345-0@lo:13: 00002000:00000024:0.0:1789061807.786123:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061807.786165:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130761856:12345-0@lo:13: Request processed in 68us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061807.786171:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789061807.786210:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd51ce00 x1875967130761856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061807.786228:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130761856:0@lo:13: 00000100:00080000:3.0:1789061807.786282:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061807.786503:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061807.786514:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130761984:0@lo:13: 00000100:00100000:3.0:1789061807.786541:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061807.786678:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130761984 00000100:00100000:0.0:1789061807.786684:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130761984 00000100:00100000:0.0:1789061807.786717:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789061807.786724:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130761984:12345-0@lo:13: 00002000:00000024:0.0:1789061807.786742:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061807.786784:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130761984:12345-0@lo:13: Request processed in 49us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061807.786790:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789061807.786815:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd51ce00 x1875967130761984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061807.786826:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130761984:0@lo:13: 00000100:00080000:3.0:1789061807.786870:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061807.792085:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130762240:0@lo:400: 00000100:00100000:2.0:1789061807.792171:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061807.792204:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130762752:0@lo:400: 00000100:00100000:2.0:1789061807.792225:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061807.792250:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061807.792255:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130762368:0@lo:400: 00000100:00100000:2.0:1789061807.792277:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061807.792308:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130762240 00000100:00100000:2.0:1789061807.792315:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130762240 00000100:00100000:2.0:1789061807.792357:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130762752 00000100:00100000:2.0:1789061807.792360:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130762752 00000100:00100000:0.0:1789061807.792520:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130762112:0@lo:400: 00000100:00100000:0.0:1789061807.792556:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061807.792590:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130762624:0@lo:400: 00000100:00100000:0.0:1789061807.792636:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061807.792650:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061807.792655:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130762496:0@lo:400: 00000100:00100000:0.0:1789061807.792679:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061807.792707:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130762496 00000100:00100000:0.0:1789061807.792710:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130762496 00000100:00100000:2.0:1789061807.792782:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130762368 00000100:00100000:2.0:1789061807.792786:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130762368 00000100:00100000:2.0:1789061807.792800:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130762624 00000100:00100000:2.0:1789061807.792802:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130762624 00000100:00100000:2.0:1789061807.792817:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789061807.792824:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130762240:12345-0@lo:400: 00000100:00100000:2.0:1789061807.792888:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130762240:12345-0@lo:400: Request processed in 51us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061807.792894:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789061807.792911:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789061807.792957:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130762112 00000100:00100000:3.0:1789061807.792962:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130762112 00000100:00100000:3.0:1789061807.792992:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789061807.792999:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3623:x1875967130762112:12345-0@lo:400: 00000100:00100000:3.0:1789061807.793037:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3623:x1875967130762112:12345-0@lo:400: Request processed in 38us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061807.793043:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789061807.795681:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789061807.795698:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130762368:12345-0@lo:400: 00000100:00100000:3.0:1789061807.795796:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130762368:12345-0@lo:400: Request processed in 104us (3516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061807.795804:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789061807.795829:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789061807.795837:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130762624:12345-0@lo:400: 00000100:00100000:3.0:1789061807.795867:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130762624:12345-0@lo:400: Request processed in 32us (3230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061807.795885:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789061807.796868:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789061807.796889:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130762496:12345-0@lo:400: 00000100:00100000:0.0:1789061807.796938:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130762496:12345-0@lo:400: Request processed in 51us (4258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061807.796944:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789061807.796983:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130762496:0@lo:400: 00000100:00100000:0.0:1789061807.796994:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130762112:0@lo:400: 00010000:00080000:0.0:1789061807.797007:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c56fed80 x1875967130762624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061807.797031:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130762624:0@lo:400: 00000100:00100000:2.0:1789061807.800989:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130762752:12345-0@lo:400: 00000100:00100000:2.0:1789061807.801072:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130762752:12345-0@lo:400: Request processed in 8155us (8846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061807.801082:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789061807.801136:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c56fd180 x1875967130762368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061807.801151:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130762368:0@lo:400: 00010000:00080000:2.0:1789061807.801175:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c56fe680 x1875967130762240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061807.801184:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130762240:0@lo:400: 00010000:00080000:2.0:1789061807.801193:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c56fc380 x1875967130762752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061807.801201:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130762752:0@lo:400: 00000100:00080000:2.0:1789061807.801229:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789061807.801234:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789061807.914757:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061808.938893:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789061809.109812:0:9488:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789061809.109815:0:9488:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789061809.109817:0:9488:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789061809.109952:0:9488:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9767fd65c800 00000020:01000004:0.0:1789061809.109967:0:9488:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789061809.109980:0:9488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789061809.110001:0:9488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9766c645b380) 00000020:00000080:0.0:1789061809.110018:0:9488:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789061809.161013:0:9488:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789061809.161062:0:9488:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1789061809.180480:0:9488:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789061809.180837:0:9488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789061809.180855:0:9488:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789061809.180867:0:9488:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2774d8f311dc65ec 00000020:01000004:3.0:1789061809.180874:0:9488:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789061809.180893:0:9488:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789061809.180897:0:9488:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789061809.180903:0:9488:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789061809.180939:0:9488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789061809.180943:0:9488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789061809.211248:0:9488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789061809.211288:0:9488:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789061809.211292:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789061809.211294:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789061809.211295:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061809.211296:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061809.211298:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061809.211299:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061809.211300:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061809.211302:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789061809.211303:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789061809.211305:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061809.211307:0:9488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789061809.211310:0:9488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789061809.211313:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789061809.211314:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789061809.211315:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061809.211316:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061809.211318:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061809.211319:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061809.211319:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061809.211321:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789061809.211322:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789061809.211323:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061809.211324:0:9488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789061809.211364:0:9488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789061809.211383:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130762880:0@lo:253: 00000100:00100000:2.0:1789061809.211450:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.211562:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9840240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061809.212675:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130762880 00000100:00100000:0.0:1789061809.212684:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130762880 00000100:00100000:0.0:1789061809.212782:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789061809.212792:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:9488:x1875967130762880:12345-0@lo:253: 20000000:01000000:0.0:1789061809.212822:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789061809.212825:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789061809.212830:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789061809.212833:0:6488:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789061809.213083:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061809.213208:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1789061809.213221:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789061809.213237:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1789061809.213242:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789061809.213252:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1789061809.213265:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1789061809.213358:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1789061809.213373:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:0.0:1789061809.213375:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:0.0:1789061809.213389:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1789061809.213394:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789061809.213407:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1789061809.213420:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:0.0:1789061809.213435:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1789061809.213441:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789061809.213452:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1789061809.213466:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1789061809.213547:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1789061809.213557:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:0.0:1789061809.213558:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:0.0:1789061809.213570:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1789061809.213575:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789061809.213586:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1789061809.213590:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:0.0:1789061809.213600:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1789061809.213625:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789061809.213639:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1789061809.213653:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1789061809.213997:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1789061809.214009:0:6488:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.103@tcp 20000000:01000000:0.0:1789061809.214011:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.103@tcp (null) (null) (null) 00000040:00080000:0.0:1789061809.214025:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1789061809.214031:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789061809.214041:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1789061809.214045:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.103@tcp (null) (null) 00000040:00080000:0.0:1789061809.214055:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1789061809.214060:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789061809.214071:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1789061809.214085:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1789061809.214096:0:6488:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789061809.214099:0:6488:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789061809.214102:0:6488:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789061809.214139:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789061809.214148:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789061809.215062:0:9494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1789061809.215094:0:9494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1789061809.215106:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789061809.215433:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789061809.215455:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1789061809.215468:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1789061809.215477:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789061809.215479:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789061809.215736:0:9495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1789061809.215755:0:9495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1789061809.215781:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1789061809.216064:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1789061809.216083:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1789061809.216096:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1789061809.216104:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789061809.216106:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789061809.216551:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1789061809.216571:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1789061809.216585:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1789061809.216667:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1789061809.216686:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1789061809.216699:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1789061809.216708:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789061809.216710:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789061809.217250:0:9497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1789061809.217330:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1789061809.217349:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1789061809.217364:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1789061809.217373:0:6488:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789061809.217375:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789061809.217483:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1789061809.217499:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1789061809.217527:0:9498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1789061809.217575:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1789061809.217589:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1789061809.217600:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:0.0:1789061809.217638:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789061809.217657:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.217674:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc64e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc64e2 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.217682:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c0030e00/0x2774d8f311dc6513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc650c expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.217688:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc654b expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.217695:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc656e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6567 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.217701:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6591 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.217713:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc65b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc65ad expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.217720:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767fd47ae00/0x2774d8f311dc65de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc65d7 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.217726:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.217759:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767fd47ae00/0x2774d8f311dc65de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc65d7 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.217784:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767fd47ae00/0x2774d8f311dc65de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc65d7 expref: 21 pid: 6491 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061809.217807:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763008:0@lo:104: 00000100:00100000:0.0:1789061809.217862:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061809.217904:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc65b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc65ad expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.217912:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc65b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc65ad expref: 21 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061809.217919:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763136:0@lo:104: 00000100:00100000:0.0:1789061809.217937:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061809.217956:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6591 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.217963:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6591 expref: 21 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061809.217976:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763264:0@lo:104: 00000100:00100000:0.0:1789061809.218003:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061809.218024:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc656e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6567 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.218031:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc656e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6567 expref: 21 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061809.218039:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763392:0@lo:104: 00000100:00100000:0.0:1789061809.218054:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061809.218067:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc654b expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.218074:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc654b expref: 21 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061809.218081:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763520:0@lo:104: 00000100:00100000:0.0:1789061809.218097:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061809.218109:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c0030e00/0x2774d8f311dc6513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc650c expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.218117:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c0030e00/0x2774d8f311dc6513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc650c expref: 21 pid: 6491 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061809.218125:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763648:0@lo:104: 00000100:00100000:0.0:1789061809.218142:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061809.218157:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc64e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc64e2 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.218174:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc64e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc64e2 expref: 21 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061809.218182:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763776:0@lo:104: 00000100:00100000:0.0:1789061809.218200:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5a5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789061809.218222:0:6478:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789061809.218237:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061809.218249:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130763008 00000100:00100000:0.0:1789061809.218255:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130763008 00000100:00100000:0.0:1789061809.218281:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130763136 00000100:00100000:0.0:1789061809.218284:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130763136 00000100:00100000:0.0:1789061809.218292:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130763264 00000100:00100000:0.0:1789061809.218294:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130763264 00000100:00100000:0.0:1789061809.218302:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130763392 00000100:00100000:0.0:1789061809.218304:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130763392 00000100:00100000:0.0:1789061809.218311:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130763520 00000100:00100000:0.0:1789061809.218313:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130763520 00000100:00100000:0.0:1789061809.218319:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130763648 00000100:00100000:0.0:1789061809.218321:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130763648 00000100:00100000:0.0:1789061809.218329:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130763776 00000100:00100000:0.0:1789061809.218331:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130763776 00000100:00100000:0.0:1789061809.218341:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789061809.218348:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+9:6488:x1875967130763008:12345-0@lo:104: 00010000:00010000:0.0:1789061809.218360:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc65de expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.218408:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789061809.218414:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+9:6488:x1875967130763008:12345-0@lo:104: Request processed in 66us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.218429:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789061809.218445:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789061809.218451:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+8:6488:x1875967130763136:12345-0@lo:104: 00010000:00010000:0.0:1789061809.218458:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc65b4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.218490:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789061809.218495:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+8:6488:x1875967130763136:12345-0@lo:104: Request processed in 46us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.218500:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789061809.218510:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789061809.218515:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+7:6488:x1875967130763264:12345-0@lo:104: 00010000:00010000:0.0:1789061809.218521:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6598 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.218548:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789061809.218553:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+7:6488:x1875967130763264:12345-0@lo:104: Request processed in 38us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.218558:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789061809.218569:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789061809.218574:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:6488:x1875967130763392:12345-0@lo:104: 00010000:00010000:0.0:1789061809.218580:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc656e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.218626:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789061809.218631:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:6488:x1875967130763392:12345-0@lo:104: Request processed in 58us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.218642:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789061809.218654:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789061809.218659:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:6488:x1875967130763520:12345-0@lo:104: 00010000:00010000:0.0:1789061809.218666:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6552 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061809.218671:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789061809.218678:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c640c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:6488:x1875967130763648:12345-0@lo:104: 00010000:00010000:3.0:1789061809.218685:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6513 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.218692:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789061809.218696:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:6488:x1875967130763520:12345-0@lo:104: Request processed in 37us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.218700:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1789061809.218711:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789061809.218711:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789061809.218715:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c640c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6488:x1875967130763648:12345-0@lo:104: Request processed in 39us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.218716:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6488:x1875967130763776:12345-0@lo:104: 00000100:00100000:3.0:1789061809.218721:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1789061809.218723:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc64e9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.218743:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1789061809.218747:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:6488:x1875967130763776:12345-0@lo:104: Request processed in 31us (510us total) trans 0 rc 0/0 00010000:00010000:3.0:1789061809.218749:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00000100:00100000:0.0:1789061809.218752:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789061809.218755:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc65de expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061809.218797:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763008:0@lo:104: 00000100:00100000:0.0:1789061809.218806:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763136:0@lo:104: 00000100:00100000:0.0:1789061809.218811:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763264:0@lo:104: 00000100:00100000:0.0:1789061809.218816:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763392:0@lo:104: 00000100:00100000:0.0:1789061809.218822:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763520:0@lo:104: 00000100:00100000:0.0:1789061809.218828:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763648:0@lo:104: 00000100:00100000:0.0:1789061809.218843:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1875967130763776:0@lo:104: 00010000:00010000:0.0:1789061809.218870:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219586:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031000 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789061809.219593:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc65de expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219603:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc65de expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061809.219628:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc65de expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061809.219644:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061809.219663:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789061809.219669:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc65b4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219675:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483600 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061809.219677:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc65b4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219679:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc65de expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219684:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc65b4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219685:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1789061809.219699:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc65b4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061809.219703:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789061809.219705:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc65de expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219712:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c0031000/0x2774d8f311dc65d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc65de expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219716:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc65b4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219720:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061809.219722:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789061809.219726:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6598 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219731:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1482800 already unused, calling callback (ffffffffc14eec20) 00010000:00010000:2.0:1789061809.219734:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc65b4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061809.219735:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6598 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219740:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc65ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc65b4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219742:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6598 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061809.219748:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6598 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219749:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789061809.219752:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc656e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061809.219753:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061809.219758:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031800 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061809.219761:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc656e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219773:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6598 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219779:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061809.219779:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc656e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061809.219785:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc656e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219790:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6598 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061809.219790:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789061809.219796:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc6591 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6598 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219806:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789061809.219808:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6552 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219814:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3798e00 already unused, calling callback (ffffffffc14eec20) 00010000:00010000:2.0:1789061809.219814:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc656e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061809.219817:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6552 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219819:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061809.219824:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6552 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219824:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc656e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061809.219831:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6552 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219831:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc656e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061809.219836:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061809.219839:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789061809.219842:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6513 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219846:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6552 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219847:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799e00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061809.219850:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6513 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219851:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061809.219855:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6552 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219856:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6513 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219862:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c3798e00/0x2774d8f311dc654b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6552 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061809.219862:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6513 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061809.219868:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789061809.219870:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061809.219877:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc64e9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219877:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6513 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219883:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061809.219884:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3798600 already unused, calling callback (ffffffffc14eec20) 00010000:00010000:2.0:1789061809.219886:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6513 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061809.219887:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc64e9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219894:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc64e9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061809.219900:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc64e9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.219901:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc650c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6513 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061809.219906:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061809.219909:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061809.219911:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061809.219913:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061809.219915:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc64e9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219919:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061809.219923:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc64e9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.219926:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130764160:0@lo:103: 00010000:00010000:3.0:1789061809.219930:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c3798600/0x2774d8f311dc64e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc64e9 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.219940:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061809.219942:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061809.219943:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061809.219949:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061809.219958:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130764288:0@lo:103: 00000100:00100000:2.0:1789061809.219967:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061809.219982:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130764032:0@lo:103: 00000100:00100000:2.0:1789061809.220008:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130764672:0@lo:103: 00000100:00100000:3.0:1789061809.220009:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061809.220025:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130764544:0@lo:103: 00000100:00100000:2.0:1789061809.220026:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061809.220049:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.220053:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130764160 00000100:00100000:2.0:1789061809.220058:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130764160 00000100:00100000:3.0:1789061809.220069:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130764032 00000100:00100000:3.0:1789061809.220072:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130764032 00010000:00010000:2.0:1789061809.220079:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6591 expref: 23 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.220083:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc65b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc65ad expref: 23 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061809.220095:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130764672 00000100:00100000:2.0:1789061809.220095:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130764544 00000100:00100000:3.0:1789061809.220098:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130764672 00000100:00100000:2.0:1789061809.220098:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130764544 00010000:00010000:3.0:1789061809.220106:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc64e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc64e2 expref: 25 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.220106:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c0030e00/0x2774d8f311dc6513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc650c expref: 25 pid: 6491 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061809.220119:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789061809.220124:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+25:3623:x1875967130764160:12345-0@lo:103: 00010000:00010000:3.0:1789061809.220134:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061809.220150:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6591 expref: 25 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.220160:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6591 expref: 25 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.220172:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6598 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6591 expref: 25 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.220183:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061809.220219:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130763904:0@lo:103: 00000100:00100000:3.0:1789061809.220220:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130764160:12345-0@lo:103: Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.220350:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061809.220365:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130764416:0@lo:103: 00000100:00100000:0.0:1789061809.220382:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061809.220430:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130764160:0@lo:103: 00000100:00100000:2.0:1789061809.220466:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789061809.220474:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130764032:12345-0@lo:103: 00010000:00010000:2.0:1789061809.220481:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061809.220486:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc65b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc65ad expref: 24 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.220494:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc65b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc65ad expref: 24 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.220510:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc65b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc65ad expref: 24 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.220518:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061809.220585:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:3622:x1875967130764032:12345-0@lo:103: Request processed in 114us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.220592:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789061809.220670:0:6480:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789061809.220679:0:6480:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789061809.221103:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130763904 00000100:00100000:2.0:1789061809.221108:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130763904 00010000:00010000:2.0:1789061809.221127:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767fd47ae00/0x2774d8f311dc65de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc65d7 expref: 23 pid: 6491 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.221142:0:6480:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789061809.221148:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130764416 00000100:00100000:2.0:1789061809.221150:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130764416 00010000:00010000:2.0:1789061809.221161:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc654b expref: 24 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.221171:0:6480:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789061809.221176:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789061809.221181:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130764544:12345-0@lo:103: 00010000:00010000:2.0:1789061809.221188:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061809.221192:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c0030e00/0x2774d8f311dc6513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc650c expref: 24 pid: 6491 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221200:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c0030e00/0x2774d8f311dc6513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc650c expref: 24 pid: 6491 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221218:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0030e00/0x2774d8f311dc6513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc650c expref: 24 pid: 6491 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221227:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061809.221255:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:3622:x1875967130764544:12345-0@lo:103: Request processed in 73us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.221261:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789061809.221280:0:6480:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789061809.221286:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789061809.221292:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:3623:x1875967130764672:12345-0@lo:103: 00010000:00010000:2.0:1789061809.221299:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061809.221304:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc64e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc64e2 expref: 22 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221311:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc64e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc64e2 expref: 22 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221320:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc64e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc64e2 expref: 22 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221327:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061809.221353:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3623:x1875967130764672:12345-0@lo:103: Request processed in 61us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.221358:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789061809.221369:0:6480:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789061809.221374:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789061809.221378:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:3621:x1875967130763904:12345-0@lo:103: 00010000:00010000:2.0:1789061809.221385:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061809.221395:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767fd47ae00/0x2774d8f311dc65de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc65d7 expref: 20 pid: 6491 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221404:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767fd47ae00/0x2774d8f311dc65de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc65d7 expref: 20 pid: 6491 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221412:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47ae00/0x2774d8f311dc65de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc65d7 expref: 20 pid: 6491 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221420:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061809.221449:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:3621:x1875967130763904:12345-0@lo:103: Request processed in 70us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.221454:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789061809.221466:0:6480:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789061809.221473:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789061809.221478:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:3621:x1875967130764416:12345-0@lo:103: 00010000:00010000:2.0:1789061809.221484:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061809.221488:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc654b expref: 18 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221496:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc654b expref: 18 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221507:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc654b expref: 18 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221516:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061809.221541:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:3621:x1875967130764416:12345-0@lo:103: Request processed in 61us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.221547:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789061809.221592:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130764672:0@lo:103: 00000100:00100000:3.0:1789061809.221778:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789061809.221806:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.221896:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130764288 00000100:00100000:2.0:1789061809.221903:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130764288 00010000:00010000:2.0:1789061809.221920:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc656e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6567 expref: 16 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.221954:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789061809.221960:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:3620:x1875967130764288:12345-0@lo:103: 00010000:00010000:2.0:1789061809.221967:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061809.221971:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc656e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6567 expref: 16 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221980:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc656e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6567 expref: 16 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.221991:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc656e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6567 expref: 16 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.222001:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.222012:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.222029:0:6480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.222036:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.222042:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.222057:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.222062:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031c00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789061809.222066:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.222073:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.222085:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.222100:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061809.222135:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:3620:x1875967130764288:12345-0@lo:103: Request processed in 174us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.222142:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789061809.222176:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130764032:0@lo:103: 00000100:00100000:0.0:1789061809.222189:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130764544:0@lo:103: 00000100:00100000:3.0:1789061809.222338:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130764288:0@lo:103: 00000100:00100000:1.0:1789061809.222828:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130763904:0@lo:103: 00000100:00100000:1.0:1789061809.222849:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130764416:0@lo:103: 00010000:00010000:2.0:1789061809.223044:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.223053:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.223060:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc65f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789061809.223074:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789061809.226164:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:9488:x1875967130762880:12345-0@lo:253: Request processed in 13366us (14706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061809.226180:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789061809.226260:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130762880:0@lo:253: 10000000:01000000:2.0:1789061809.226275:0:9488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789061809.226291:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789061809.226293:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789061809.226294:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061809.226296:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789061809.226297:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061809.226298:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061809.226299:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061809.226301:0:9488:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789061809.226302:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061809.226303:0:9488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789061809.226323:0:9488:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9767fd65c800 from lustre-OST0001 10000000:01000000:2.0:1789061809.226353:0:9488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789061809.226356:0:9488:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789061809.226365:0:9488:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9767f38a8000 local copy 10000000:01000000:2.0:1789061809.226369:0:9488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789061809.226403:0:9488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.226415:0:9488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.226425:0:9488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.226443:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130764800:0@lo:101: 00000100:00100000:2.0:1789061809.226477:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061809.226590:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130764800 00000100:00100000:1.0:1789061809.226597:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130764800 00000100:00100000:1.0:1789061809.226692:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789061809.226702:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:9488:x1875967130764800:12345-0@lo:101: 00010000:00010000:1.0:1789061809.226715:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061809.226727:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47b000/0x2774d8f311dc6601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc65fa expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061809.226749:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b000/0x2774d8f311dc6601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc65fa expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061809.226760:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47b000/0x2774d8f311dc6601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc65fa expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061809.226779:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b000, rc 0) 00000100:00100000:1.0:1789061809.226806:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130764800:12345-0@lo:101: Request processed in 106us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061809.226812:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789061809.226913:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd427600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061809.226927:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130764800:0@lo:101: 00010000:00010000:2.0:1789061809.226939:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2774d8f311dc6601 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.226947:0:9488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2774d8f311dc6601 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.227040:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130764928:0@lo:501: 00000100:00100000:2.0:1789061809.227066:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.227644:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd427600 going to sleep for 11 seconds 00000100:00100000:0.0:1789061809.227692:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130764928 00000100:00100000:0.0:1789061809.227697:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130764928 00000100:00100000:0.0:1789061809.227723:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789061809.227731:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130764928:12345-0@lo:501: 00000100:00100000:0.0:1789061809.227837:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130764928:12345-0@lo:501: Request processed in 107us (769us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789061809.227844:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789061809.227980:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130764928:0@lo:501: 10000000:01000000:2.0:1789061809.227994:0:9488:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789061809.228012:0:9488:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789061809.228017:0:9488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2774d8f311dc6601 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.228026:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2774d8f311dc6601 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.228032:0:9488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2774d8f311dc6601 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.228055:0:9488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789061809.228082:0:9488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9767fd65c800 10000000:01000000:2.0:1789061809.228087:0:9488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789061809.228092:0:9488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789061809.228095:0:9488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789061809.228099:0:9488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789061809.228102:0:9488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789061809.228120:0:9488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.228128:0:9488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.228181:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061809.228188:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x2774d8f311dc6601 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.228196:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1482600 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789061809.228199:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x2774d8f311dc6601 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.228208:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x2774d8f311dc6601 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061809.228215:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x2774d8f311dc6601 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061809.228221:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789061809.228240:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x2774d8f311dc6601 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.228246:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061809.228275:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x2774d8f311dc6601 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.228282:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc65fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x2774d8f311dc6601 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.228293:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061809.228301:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061809.228303:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061809.228310:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061809.228321:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130765184:0@lo:103: 00000100:00100000:3.0:1789061809.228353:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061809.228355:0:9488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.228367:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765056:0@lo:101: 00000100:00100000:2.0:1789061809.228391:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061809.228430:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130765184 00000100:00100000:0.0:1789061809.228435:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130765184 00000100:00100000:0.0:1789061809.228465:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789061809.228473:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:3621:x1875967130765184:12345-0@lo:103: 00010000:00010000:0.0:1789061809.228482:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061809.228494:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47b000/0x2774d8f311dc6601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc65fa expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.228578:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061809.228634:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:3621:x1875967130765184:12345-0@lo:103: Request processed in 161us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.228641:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061809.228734:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd427480 going to sleep for 11 seconds 00000100:00100000:1.0:1789061809.228760:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130765056 00000100:00100000:1.0:1789061809.228773:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130765056 00000100:00100000:1.0:1789061809.228886:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789061809.228894:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+14:9488:x1875967130765056:12345-0@lo:101: 00010000:00010000:1.0:1789061809.228902:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061809.228912:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc660f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6608 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061809.228928:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc660f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6608 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061809.228946:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc660f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6608 expref: 15 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061809.228953:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b600, rc 0) 00000100:00100000:1.0:1789061809.228989:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130765056:12345-0@lo:101: Request processed in 96us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061809.228994:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789061809.229051:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765056:0@lo:101: 00010000:00010000:2.0:1789061809.229062:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc660f expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.229071:0:9488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc660f expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.229133:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765312:0@lo:501: 00000100:00100000:2.0:1789061809.229267:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061809.229322:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130765312 00000100:00100000:3.0:1789061809.229327:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130765312 00000100:00100000:2.0:1789061809.229330:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd427480 going to sleep for 11 seconds 00000100:00100000:3.0:1789061809.229347:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789061809.229353:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130765312:12345-0@lo:501: 00000100:00100000:3.0:1789061809.229459:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130765312:12345-0@lo:501: Request processed in 106us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061809.229465:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789061809.229496:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130765184:0@lo:103: 00000100:00100000:2.0:1789061809.229867:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765312:0@lo:501: 00000100:00100000:2.0:1789061809.229894:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765440:0@lo:503: 00000100:00100000:2.0:1789061809.229935:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.229986:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd427480 going to sleep for 11 seconds 00000100:00100000:0.0:1789061809.230014:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130765440 00000100:00100000:0.0:1789061809.230018:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130765440 00000100:00100000:0.0:1789061809.230074:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789061809.230082:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130765440:12345-0@lo:503: 00000100:00100000:0.0:1789061809.230222:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130765440:12345-0@lo:503: Request processed in 141us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.230229:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789061809.230286:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765440:0@lo:503: 00000040:00080000:2.0:1789061809.230519:0:9488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789061809.230574:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765568:0@lo:502: 00000100:00100000:2.0:1789061809.230639:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.230868:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd427480 going to sleep for 11 seconds 00000100:00100000:1.0:1789061809.230903:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130765568 00000100:00100000:1.0:1789061809.230908:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130765568 00000100:00100000:1.0:1789061809.230929:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789061809.230936:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130765568:12345-0@lo:502: 00000100:00100000:1.0:1789061809.231055:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130765568:12345-0@lo:502: Request processed in 119us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061809.231062:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789061809.231129:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765568:0@lo:502: 00000040:00080000:2.0:1789061809.231404:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789061809.231429:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789061809.231443:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789061809.231457:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789061809.231482:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789061809.231497:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789061809.231586:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765696:0@lo:502: 00000100:00100000:2.0:1789061809.231717:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.231787:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd427480 going to sleep for 11 seconds 00000100:00100000:1.0:1789061809.231832:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130765696 00000100:00100000:1.0:1789061809.231838:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130765696 00000100:00100000:1.0:1789061809.231870:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789061809.231876:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130765696:12345-0@lo:502: 00000100:00100000:1.0:1789061809.231985:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130765696:12345-0@lo:502: Request processed in 108us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061809.231992:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789061809.232053:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765696:0@lo:502: 00000040:00080000:2.0:1789061809.232087:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789061809.232094:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1789061809.232594:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789061809.232602:0:9500:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789061809.234043:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061809.234048:0:9500:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789061809.234059:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789061809.234076:0:9500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9767fb32cd40) 00000020:00000080:2.0:1789061809.234100:0:9500:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789061809.234107:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789061809.234250:0:9500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767fd65c800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789061809.234259:0:9500:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789061809.234323:0:9500:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2774d8f311dc661d 00010000:00010000:2.0:1789061809.244063:0:9500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1789061809.244386:0:9500:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789061809.247534:0:9500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789061809.247917:0:9500:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789061809.251410:0:9500:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789061809.251589:0:9500:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789061809.257568:0:9500:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789061809.263864:0:9500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789061809.263882:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061809.263889:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061809.263892:0:9500:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789061809.263895:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061809.263900:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061809.263902:0:9500:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789061809.263906:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789061809.263908:0:9500:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789061809.263932:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061809.263935:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061809.263936:0:9500:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789061809.263939:0:9500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789061809.264181:0:9488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789061809.264210:0:9488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789061809.264236:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc660f expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.264248:0:9488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc660f expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061809.264257:0:9488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fd65c800 from 1 10000000:01000000:2.0:1789061809.264259:0:9488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061809.264293:0:9488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.264300:0:9488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.264310:0:9488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.264330:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765824:0@lo:101: 00000100:00100000:2.0:1789061809.264401:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.264439:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd481c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789061809.264544:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130765824 00000100:00100000:0.0:1789061809.264552:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130765824 00000100:00100000:0.0:1789061809.264600:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789061809.264632:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:9488:x1875967130765824:12345-0@lo:101: 00010000:00010000:0.0:1789061809.264645:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061809.264657:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0030600/0x2774d8f311dc662b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6624 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.264680:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0030600/0x2774d8f311dc662b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6624 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.264690:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0030600/0x2774d8f311dc662b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6624 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.264698:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030600, rc 0) 00000100:00100000:0.0:1789061809.264735:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9488:x1875967130765824:12345-0@lo:101: Request processed in 106us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.264750:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789061809.264850:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765824:0@lo:101: 00010000:00010000:2.0:1789061809.264864:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc662b expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.264879:0:9488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc662b expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.264957:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765952:0@lo:501: 00000100:00100000:2.0:1789061809.264985:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.265013:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd481c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789061809.265056:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130765952 00000100:00100000:0.0:1789061809.265061:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130765952 00000100:00100000:0.0:1789061809.265083:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789061809.265090:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9488:x1875967130765952:12345-0@lo:501: 00000100:00100000:0.0:1789061809.265184:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9488:x1875967130765952:12345-0@lo:501: Request processed in 94us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.265191:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789061809.265251:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130765952:0@lo:501: 00000100:00100000:2.0:1789061809.265275:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766080:0@lo:503: 00000100:00100000:2.0:1789061809.265313:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.265326:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd481c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061809.265338:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130766080 00000100:00100000:2.0:1789061809.265341:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130766080 00000100:00100000:2.0:1789061809.265370:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789061809.265376:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9488:x1875967130766080:12345-0@lo:503: 00000100:00100000:2.0:1789061809.265445:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9488:x1875967130766080:12345-0@lo:503: Request processed in 69us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.265452:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789061809.265488:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766080:0@lo:503: 00000040:00080000:2.0:1789061809.267267:0:9488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789061809.267353:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766208:0@lo:502: 00000100:00100000:2.0:1789061809.267420:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.267453:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061809.267474:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130766208 00000100:00100000:2.0:1789061809.267479:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130766208 00000100:00100000:2.0:1789061809.267511:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789061809.267518:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9488:x1875967130766208:12345-0@lo:502: 00000100:00100000:2.0:1789061809.267638:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9488:x1875967130766208:12345-0@lo:502: Request processed in 119us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.267648:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789061809.267703:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766208:0@lo:502: 00000040:00080000:2.0:1789061809.267904:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789061809.267928:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789061809.267948:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766336:0@lo:502: 00000100:00100000:2.0:1789061809.267982:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.268017:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061809.268292:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130766336 00000100:00100000:0.0:1789061809.268298:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130766336 00000100:00100000:0.0:1789061809.268332:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789061809.268341:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9488:x1875967130766336:12345-0@lo:502: 00000100:00100000:0.0:1789061809.268422:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9488:x1875967130766336:12345-0@lo:502: Request processed in 82us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.268429:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789061809.268566:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766336:0@lo:502: 00000040:00080000:2.0:1789061809.268638:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789061809.268648:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789061809.268896:0:9504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061809.268906:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061809.268909:0:9504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789061809.268917:0:9504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767fd65c800 00000020:00000080:2.0:1789061809.268920:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789061809.268932:0:9504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061809.268936:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061809.268937:0:9504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789061809.268940:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789061809.268972:0:9488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789061809.269001:0:9488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061809.269016:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc662b expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.269028:0:9488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc662b expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061809.269081:0:9488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789061809.269085:0:9488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9767fd65c800 10000000:01000000:2.0:1789061809.269088:0:9488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9767fd65c800 10000000:01000000:2.0:1789061809.269092:0:9488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789061809.269097:0:9488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767fd65c800 from 1 10000000:01000000:2.0:1789061809.269100:0:9488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789061809.269272:0:9488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.269282:0:9488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.269293:0:9488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.269309:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766464:0@lo:101: 00000100:00100000:2.0:1789061809.269358:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.269384:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd427f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061809.269401:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130766464 00000100:00100000:2.0:1789061809.269406:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130766464 00000100:00100000:2.0:1789061809.269437:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789061809.269446:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9488:x1875967130766464:12345-0@lo:101: 00010000:00010000:2.0:1789061809.269457:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061809.269478:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c1483200/0x2774d8f311dc6639 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6632 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.269502:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1483200/0x2774d8f311dc6639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6632 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.269515:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c1483200/0x2774d8f311dc6639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6632 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.269525:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c1483200, rc 0) 00000100:00100000:2.0:1789061809.269559:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9488:x1875967130766464:12345-0@lo:101: Request processed in 114us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.269565:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789061809.269630:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766464:0@lo:101: 00010000:00010000:2.0:1789061809.269646:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6639 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.269656:0:9488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6639 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.269727:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766592:0@lo:501: 00000100:00100000:2.0:1789061809.269758:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.269789:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd427f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061809.269802:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130766592 00000100:00100000:2.0:1789061809.269806:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130766592 00000100:00100000:2.0:1789061809.269831:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789061809.269837:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9488:x1875967130766592:12345-0@lo:501: 00000100:00100000:2.0:1789061809.269924:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9488:x1875967130766592:12345-0@lo:501: Request processed in 87us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.269941:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789061809.269976:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766592:0@lo:501: 00000100:00100000:2.0:1789061809.270000:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766720:0@lo:503: 00000100:00100000:2.0:1789061809.270040:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.270054:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd427f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061809.270068:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130766720 00000100:00100000:2.0:1789061809.270072:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130766720 00000100:00100000:2.0:1789061809.270093:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789061809.270098:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9488:x1875967130766720:12345-0@lo:503: 00000100:00100000:2.0:1789061809.270192:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9488:x1875967130766720:12345-0@lo:503: Request processed in 93us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.270199:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789061809.270244:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766720:0@lo:503: 00000040:00080000:2.0:1789061809.270430:0:9488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789061809.270488:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766848:0@lo:502: 00000100:00100000:2.0:1789061809.270519:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.270532:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd427f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061809.270544:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130766848 00000100:00100000:2.0:1789061809.270547:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130766848 00000100:00100000:2.0:1789061809.270567:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789061809.270573:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9488:x1875967130766848:12345-0@lo:502: 00000100:00100000:2.0:1789061809.272936:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9488:x1875967130766848:12345-0@lo:502: Request processed in 2357us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.272950:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789061809.273052:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766848:0@lo:502: 00000040:00080000:3.0:1789061809.273400:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789061809.273430:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789061809.273443:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789061809.273456:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789061809.273470:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789061809.273483:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789061809.273497:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789061809.273510:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789061809.273523:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789061809.273535:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789061809.273548:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789061809.273562:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789061809.273575:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789061809.273588:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789061809.273601:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789061809.273731:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789061809.273746:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789061809.273787:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789061809.273806:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789061809.273824:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789061809.273840:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789061809.273854:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789061809.273869:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789061809.273885:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789061809.273899:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789061809.273913:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789061809.273927:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789061809.273940:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789061809.273955:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789061809.273970:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789061809.273984:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789061809.273998:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789061809.274012:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789061809.274043:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789061809.274059:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789061809.274070:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789061809.274082:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1789061809.274100:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789061809.274779:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1789061809.274800:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1789061809.274821:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1789061809.274843:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1789061809.274867:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1789061809.274890:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1789061809.274912:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1789061809.274932:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1789061809.274975:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766976:0@lo:502: 00000100:00100000:3.0:1789061809.275048:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061809.275086:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061809.277142:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130766976 00000100:00100000:0.0:1789061809.277154:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130766976 00000100:00100000:0.0:1789061809.277222:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789061809.277232:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9488:x1875967130766976:12345-0@lo:502: 00000100:00100000:0.0:1789061809.277399:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9488:x1875967130766976:12345-0@lo:502: Request processed in 168us (2350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.277409:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789061809.277436:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130766976:0@lo:502: 00000040:00080000:2.0:1789061809.277526:0:9488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1789061809.277538:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1789061809.278879:0:9506:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789061809.278901:0:9506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9766c71e0000) 00000020:00000080:3.0:1789061809.278926:0:9506:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1789061809.279000:0:9506:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767fd65c800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789061809.279004:0:9506:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767fd65c800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789061809.279006:0:9506:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fd65c800 3 00010000:00080000:3.0:1789061809.279035:0:9506:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767fb28a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1789061809.283231:0:9506:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1789061809.283457:0:9506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789061809.283501:0:9506:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789061809.283514:0:9506:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2774d8f311dc6647 00000100:00080000:3.0:1789061809.283524:0:9506:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789061809.283536:0:9506:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9767fb28a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1789061809.283572:0:9506:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c676c380 x1875967130767104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789061809.283600:0:9506:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789061809.284161:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130767232:0@lo:400: 00000100:00100000:2.0:1789061809.284225:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.284256:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130767744:0@lo:400: 00000100:00100000:2.0:1789061809.284281:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.284303:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789061809.284309:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130767616:0@lo:400: 00000100:00100000:2.0:1789061809.284333:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.284363:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130768128:0@lo:400: 00000100:00100000:2.0:1789061809.284386:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.284413:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130767360:0@lo:400: 00000100:00100000:2.0:1789061809.284434:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.284450:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130767872:0@lo:400: 00000100:00100000:2.0:1789061809.284468:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.284483:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789061809.284488:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130767488:0@lo:400: 00000100:00100000:2.0:1789061809.284506:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.284520:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130768000:0@lo:400: 00000100:00100000:2.0:1789061809.284538:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.284565:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130767232 00000100:00100000:2.0:1789061809.284572:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130767232 00000100:00100000:2.0:1789061809.284636:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130767744 00000100:00100000:2.0:1789061809.284639:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130767744 00000100:00100000:2.0:1789061809.284667:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130767872 00000100:00100000:2.0:1789061809.284669:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130767872 00000100:00100000:2.0:1789061809.284680:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130767488 00000100:00100000:2.0:1789061809.284689:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130767488 00000100:00100000:2.0:1789061809.284706:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789061809.284714:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130767232:12345-0@lo:400: 00000100:00100000:2.0:1789061809.284760:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130767232:12345-0@lo:400: Request processed in 46us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.284777:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789061809.284791:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789061809.284797:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130767744:12345-0@lo:400: 00000100:00100000:2.0:1789061809.284819:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130767744:12345-0@lo:400: Request processed in 23us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.284823:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789061809.284833:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789061809.284837:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130767872:12345-0@lo:400: 00000100:00100000:2.0:1789061809.284859:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130767872:12345-0@lo:400: Request processed in 22us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.284863:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789061809.284871:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789061809.284875:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130767488:12345-0@lo:400: 00000100:00100000:2.0:1789061809.284892:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130767488:12345-0@lo:400: Request processed in 17us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.284897:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789061809.284914:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130767616 00000100:00100000:2.0:1789061809.284917:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130767616 00000100:00100000:2.0:1789061809.284938:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130767360 00000100:00100000:2.0:1789061809.284940:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130767360 00000100:00100000:2.0:1789061809.284954:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789061809.284960:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130767616:12345-0@lo:400: 00000100:00100000:2.0:1789061809.285006:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130767616:12345-0@lo:400: Request processed in 46us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.285012:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789061809.285024:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789061809.285031:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130767360:12345-0@lo:400: 00000100:00100000:2.0:1789061809.285060:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130767360:12345-0@lo:400: Request processed in 30us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.285065:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789061809.285083:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130768128 00000100:00100000:2.0:1789061809.285086:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130768128 00000100:00100000:2.0:1789061809.285113:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130768000 00000100:00100000:2.0:1789061809.285116:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130768000 00000100:00100000:2.0:1789061809.285134:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789061809.285141:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130768128:12345-0@lo:400: 00000100:00100000:2.0:1789061809.285169:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130768128:12345-0@lo:400: Request processed in 29us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.285175:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789061809.285186:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061809.285193:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130768000:12345-0@lo:400: 00000100:00100000:2.0:1789061809.285232:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130768000:12345-0@lo:400: Request processed in 39us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.285238:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789061809.285275:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061809.285280:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789061809.285282:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789061809.285315:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c676a680 x1875967130767488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061809.285342:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130767488:0@lo:400: 00010000:00080000:2.0:1789061809.285355:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c6769880 x1875967130768000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061809.285363:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130768000:0@lo:400: 00000100:00100000:2.0:1789061809.285372:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130767360:0@lo:400: 00010000:00080000:2.0:1789061809.285381:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c6769500 x1875967130767872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061809.285389:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130767872:0@lo:400: 00000100:00100000:2.0:1789061809.285421:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130767616:0@lo:400: 00010000:00080000:2.0:1789061809.285430:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c6768e00 x1875967130768128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061809.285438:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130768128:0@lo:400: 00010000:00080000:2.0:1789061809.285448:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c6768000 x1875967130767232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061809.285456:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130767232:0@lo:400: 00010000:00080000:2.0:1789061809.285465:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c6769180 x1875967130767744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061809.285472:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130767744:0@lo:400: 00000100:00100000:0.0:1789061809.285912:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875967130767104:0@lo:38: 00000100:00100000:0.0:1789061809.285954:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.286002:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130767104 00000100:00100000:2.0:1789061809.286007:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130767104 00000100:00100000:2.0:1789061809.286035:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789061809.286040:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875967130767104:12345-0@lo:38: 00010000:00080000:2.0:1789061809.286069:0:6498:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1789061809.286097:0:6498:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2774d8f311dc664e 00000020:01000004:3.0:1789061809.286301:0:9506:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789061809.286315:0:9506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9766c71e19c0) 00000020:00000080:3.0:1789061809.286333:0:9506:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000004:00100000:2.0:1789061809.286418:0:6498:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789061809.286449:0:6498:0:(import.c:65:import_set_state_nolock()) ffff9766c7178800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061809.286491:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875967130767104:12345-0@lo:38: Request processed in 450us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.286498:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789061809.286531:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c676c380 x1875967130767104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789061819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061809.286540:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789061809.286547:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789061809.286554:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789061809.286559:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789061809.286561:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fb28a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789061809.286566:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875967130767104:0@lo:38: 00000020:01000004:3.0:1789061809.286723:0:9506:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767fd65c800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789061809.286728:0:9506:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767fd65c800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789061809.286731:0:9506:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fd65c800 3 00010000:00080000:3.0:1789061809.286760:0:9506:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767fd2c3800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.103@tcp at head 00000100:00100000:0.0:1789061809.286812:0:9507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9507:1875967130768256:0@lo:901: 00000100:00100000:0.0:1789061809.286845:0:9507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061809.286875:0:9507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa000 going to sleep for 11 seconds 00000100:00100000:2.0:1789061809.287273:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130768256 00000100:00100000:2.0:1789061809.287279:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130768256 00000100:00100000:2.0:1789061809.287318:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061809.287326:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9507:x1875967130768256:12345-0@lo:901: 00000100:00100000:2.0:1789061809.287730:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9507:x1875967130768256:12345-0@lo:901: Request processed in 404us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.287739:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789061809.287784:0:9507:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9767fd51f480 x1875967130768256/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789061825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061809.287795:0:9507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9507:1875967130768256:0@lo:901: 00000100:00080000:2.0:1789061809.287943:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789061809.294441:0:9506:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1789061809.294651:0:9506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789061809.294696:0:9506:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789061809.294719:0:9506:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2774d8f311dc665c 00000100:00080000:3.0:1789061809.294728:0:9506:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789061809.294741:0:9506:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9767fd2c3800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1789061809.296146:0:9506:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c676e680 x1875967130768384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789061809.296177:0:9506:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789061809.296492:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875967130768384:0@lo:38: 00000100:00100000:2.0:1789061809.296561:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061809.296830:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130768384 00000100:00100000:3.0:1789061809.296838:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130768384 00000100:00100000:3.0:1789061809.296880:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789061809.296889:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875967130768384:12345-0@lo:38: 00010000:00080000:3.0:1789061809.296917:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1789061809.296956:0:8435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2774d8f311dc6663 00000004:00100000:3.0:1789061809.296972:0:8435:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789061809.297014:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9766c7449800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061809.297076:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875967130768384:12345-0@lo:38: Request processed in 187us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061809.297084:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789061809.297114:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c676e680 x1875967130768384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789061819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061809.297125:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789061809.297134:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789061809.297142:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789061809.297147:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789061809.297149:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c3800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789061809.297154:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875967130768384:0@lo:38: 00000040:00080000:3.0:1789061809.297385:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1789061809.297760:0:9488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1789061809.297804:0:9488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789061809.297857:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6639 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.297870:0:9488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6639 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789061809.297923:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789061809.297925:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789061809.297927:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061809.297928:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061809.297929:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061809.297931:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061809.297933:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061809.297935:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789061809.297936:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789061809.297938:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061809.297939:0:9488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789061809.297943:0:9488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789061809.297945:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789061809.297947:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789061809.297948:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789061809.297949:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789061809.297951:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789061809.297952:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789061809.297953:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789061809.297954:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789061809.297955:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789061809.297956:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789061809.297957:0:9488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789061809.297975:0:9488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789061809.297995:0:9488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130768512:0@lo:253: 00000100:00100000:2.0:1789061809.298046:0:9488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.298083:0:9488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5260c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061809.298296:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130768512 00000100:00100000:0.0:1789061809.298302:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130768512 00000100:00100000:0.0:1789061809.298478:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789061809.298487:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9488:x1875967130768512:12345-0@lo:253: 20000000:01000000:0.0:1789061809.298512:0:6488:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789061809.298524:0:6488:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789061809.315902:0:6488:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789061809.315923:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789061809.316007:0:6512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789061809.316012:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789061809.316033:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.316052:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6559 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.316059:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c1483c00/0x2774d8f311dc65a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc659f expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.316081:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.316119:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c1483c00/0x2774d8f311dc65a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc659f expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.316134:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c1483c00/0x2774d8f311dc65a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc659f expref: 17 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061809.316147:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130768640:0@lo:104: 00000100:00100000:3.0:1789061809.316197:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061809.316226:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9488:x1875967130768512:12345-0@lo:253: Request processed in 17738us (18178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.316238:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00010000:3.0:1789061809.316255:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6559 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.316266:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6560 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6559 expref: 16 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061809.316275:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130768768:0@lo:104: 00000100:00100000:0.0:1789061809.316284:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130768640 00000100:00100000:0.0:1789061809.316294:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130768640 00000100:00100000:3.0:1789061809.316300:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061809.316328:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789061809.316354:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130768768 00000100:00100000:0.0:1789061809.316358:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130768768 00000100:00100000:0.0:1789061809.316374:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789061809.316382:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6512:x1875967130768640:12345-0@lo:104: 00010000:00010000:0.0:1789061809.316393:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc65a6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.316470:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789061809.316481:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6512:x1875967130768768:12345-0@lo:104: 00010000:00010000:2.0:1789061809.316492:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6560 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061809.317265:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789061809.317268:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061809.317276:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc65a6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061809.317283:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483000 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789061809.317287:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc65a6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061809.317305:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc65a6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061809.317313:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc65a6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061809.317319:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789061809.317620:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc65a6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061809.317628:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061809.317648:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc65a6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061809.317656:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc659f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc65a6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061809.317670:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061809.317672:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061809.317674:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061809.318962:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:6512:x1875967130768640:12345-0@lo:104: Request processed in 2575us (2760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.318974:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789061809.319072:0:9488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9488:1875967130768512:0@lo:253: 10000000:01000000:0.0:1789061809.319088:0:9488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789061809.319091:0:9488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789061809.319092:0:9488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789061809.319094:0:9488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789061809.319095:0:9488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789061809.319096:0:9488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789061809.319097:0:9488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789061809.319098:0:9488:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789061809.319100:0:9488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789061809.319101:0:9488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789061809.319102:0:9488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789061809.319104:0:9488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789061809.319119:0:9488:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789061809.322897:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130768640:0@lo:104: 00010000:00010000:2.0:1789061809.323438:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789061809.323448:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:6512:x1875967130768768:12345-0@lo:104: Request processed in 6968us (7146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.323460:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789061809.323475:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1875967130768768:0@lo:104: 00010000:00010000:3.0:1789061809.323504:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.323515:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130768896:0@lo:103: 00000100:00100000:2.0:1789061809.323634:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061809.323696:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061809.323704:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6560 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.323713:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031400 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061809.323718:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6560 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.323729:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6560 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061809.323751:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6560 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061809.323755:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130768896 10000000:01000000:2.0:1789061809.323759:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789061809.323775:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130768896 00010000:00010000:3.0:1789061809.323805:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c1483c00/0x2774d8f311dc65a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc659f expref: 17 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.323810:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6560 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.323824:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061809.323843:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6560 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.323851:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6559 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6560 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061809.323858:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789061809.323869:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:3621:x1875967130768896:12345-0@lo:103: 00010000:00010000:2.0:1789061809.323871:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061809.323874:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061809.323876:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061809.323883:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789061809.323887:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130769024:0@lo:103: 00010000:00010000:3.0:1789061809.323893:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c1483c00/0x2774d8f311dc65a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc659f expref: 17 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.323907:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c1483c00/0x2774d8f311dc65a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc659f expref: 17 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.323916:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789061809.323924:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1483c00/0x2774d8f311dc65a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc659f expref: 17 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.323939:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061809.323949:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130769024 00000100:00100000:2.0:1789061809.323954:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130769024 00010000:00010000:2.0:1789061809.323970:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6560 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6559 expref: 17 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061809.323980:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:3621:x1875967130768896:12345-0@lo:103: Request processed in 112us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061809.323987:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789061809.324000:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789061809.324009:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:3622:x1875967130769024:12345-0@lo:103: 00010000:00010000:2.0:1789061809.324018:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061809.324023:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6560 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6559 expref: 16 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.324038:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6559 expref: 16 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.324118:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6559 expref: 16 pid: 6488 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.324130:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.324138:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789061809.324151:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008140025s 00010000:00010000:2.0:1789061809.324156:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.324164:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.324170:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.324177:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.324182:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799c00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789061809.324186:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.324193:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.324220:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061809.324230:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061809.324257:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:3622:x1875967130769024:12345-0@lo:103: Request processed in 249us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061809.324265:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789061809.324269:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.324279:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061809.324285:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc666a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061809.324295:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130768896:0@lo:103: 00000100:00100000:2.0:1789061809.324405:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130769024:0@lo:103: 00080000:10000000:1.0:1789061809.329050:0:9488:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789061809.329217:0:9488:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789061809.329635:0:9488:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789061809.329813:0:9488:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789061809.330590:0:9488:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789061809.330851:0:9488:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789061809.333954:0:9488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789061809.346492:0:9488:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789061809.346501:0:9488:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789061809.346543:0:9488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789061809.346591:0:9488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789061809.346683:0:9488:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789061809.346831:0:9488:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789061809.347903:0:9488:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789061809.348085:0:9488:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1789061809.838769:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061809.838794:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130769152:0@lo:41: 00000100:00100000:2.0:1789061809.838861:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061809.838953:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130769152 00000100:00100000:0.0:1789061809.838960:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130769152 00000100:00100000:0.0:1789061809.839026:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789061809.839035:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130769152:12345-0@lo:41: 00000004:00000024:0.0:1789061809.839067:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789061809.839122:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130769152:12345-0@lo:41: Request processed in 87us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061809.839130:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789061809.839336:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130769152:0@lo:41: 00010000:00010000:0.0:1789061809.963176:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789061810.128086:0:9562:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789061810.128323:0:9562:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789061810.985735:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061812.010903:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061812.394862:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061812.394897:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130769280:0@lo:41: 00000100:00100000:0.0:1789061812.394993:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061812.395116:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130769280 00000100:00100000:3.0:1789061812.395127:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130769280 00000100:00100000:3.0:1789061812.395192:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789061812.395203:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130769280:12345-0@lo:41: 00000004:00000024:3.0:1789061812.395260:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789061812.395318:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130769280:12345-0@lo:41: Request processed in 116us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061812.395325:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789061812.395466:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130769280:0@lo:41: 00000100:00100000:0.0:1789061812.906254:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061812.906289:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130769408:0@lo:13: 00000100:00100000:0.0:1789061812.906401:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061812.906489:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130769408 00000100:00100000:0.0:1789061812.906499:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130769408 00000100:00100000:0.0:1789061812.906569:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789061812.906581:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130769408:12345-0@lo:13: 00002000:00000024:0.0:1789061812.906649:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061812.906701:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130769408:12345-0@lo:13: Request processed in 123us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061812.906709:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789061812.906749:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789061812.906787:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd51ca80 x1875967130769408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061812.906807:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130769408:0@lo:13: 00000100:00100000:2.0:1789061812.910999:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130769536:0@lo:13: 00000100:00100000:2.0:1789061812.911094:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061812.911576:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130769536 00000100:00100000:1.0:1789061812.911601:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130769536 00000100:00100000:1.0:1789061812.911719:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789061812.911731:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130769536:12345-0@lo:13: 00002000:00000024:1.0:1789061812.911769:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061812.911831:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130769536:12345-0@lo:13: Request processed in 101us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061812.911838:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789061812.911893:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd345c00 x1875967130769536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061812.911915:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130769536:0@lo:13: 00000100:00080000:2.0:1789061812.912272:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789061813.034965:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061814.065644:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789061814.444540:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789061814.444548:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767fd12c000 from 39 10000000:01000000:0.0:1789061814.444554:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789061814.444599:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061814.444632:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061814.444644:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061814.444667:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130769664:0@lo:101: 00000100:00100000:0.0:1789061814.444817:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.444872:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa900 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.444987:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130769664 00000100:00100000:0.0:1789061814.444995:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130769664 00000100:00100000:0.0:1789061814.445039:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789061814.445048:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130769664:12345-0@lo:101: 00010000:00010000:0.0:1789061814.445061:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061814.445072:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6671 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061814.445094:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6671 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061814.445103:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6671 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061814.445111:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030800, rc 0) 00000100:00100000:0.0:1789061814.445147:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130769664:12345-0@lo:101: Request processed in 100us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.445153:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789061814.445187:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130769792:0@lo:400: 00000100:00100000:0.0:1789061814.445214:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.445235:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130770304:0@lo:400: 00000100:00100000:0.0:1789061814.445254:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.445269:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130770816:0@lo:400: 00000100:00100000:0.0:1789061814.445287:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.445305:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789061814.445311:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130770176:0@lo:400: 00000100:00100000:0.0:1789061814.445333:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.445360:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130770688:0@lo:400: 00000100:00100000:0.0:1789061814.445382:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.445408:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130769920:0@lo:400: 00000100:00100000:0.0:1789061814.445430:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.445452:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130770432:0@lo:400: 00000100:00100000:0.0:1789061814.445470:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.445485:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130770944:0@lo:400: 00000100:00100000:0.0:1789061814.445516:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.445532:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789061814.445537:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130770048:0@lo:400: 00000100:00100000:0.0:1789061814.445558:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.445568:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130770560:0@lo:400: 00000100:00100000:0.0:1789061814.445585:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.445651:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130769664:0@lo:101: 00010000:00010000:0.0:1789061814.445665:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6678 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061814.445674:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6678 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061814.445739:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130771072:0@lo:501: 00000100:00100000:0.0:1789061814.445763:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.445777:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa900 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.445791:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130769792 00000100:00100000:0.0:1789061814.445795:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130769792 00000100:00100000:0.0:1789061814.445815:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130770304 00000100:00100000:0.0:1789061814.445818:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130770304 00000100:00100000:0.0:1789061814.445847:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130770816 00000100:00100000:0.0:1789061814.445850:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130770816 00000100:00100000:0.0:1789061814.445860:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130770432 00000100:00100000:0.0:1789061814.445862:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130770432 00000100:00100000:0.0:1789061814.445872:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130770944 00000100:00100000:0.0:1789061814.445874:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130770944 00000100:00100000:0.0:1789061814.445884:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130770048 00000100:00100000:0.0:1789061814.445886:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130770048 00000100:00100000:0.0:1789061814.445898:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789061814.445905:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130769792:12345-0@lo:400: 00000100:00100000:0.0:1789061814.445942:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130769792:12345-0@lo:400: Request processed in 37us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.445948:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789061814.445960:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789061814.445966:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130770304:12345-0@lo:400: 00000100:00100000:0.0:1789061814.445993:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130770304:12345-0@lo:400: Request processed in 27us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.445999:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789061814.446010:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789061814.446016:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130770816:12345-0@lo:400: 00000100:00100000:0.0:1789061814.446040:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130770816:12345-0@lo:400: Request processed in 24us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.446044:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789061814.446055:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789061814.446060:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130770432:12345-0@lo:400: 00000100:00100000:0.0:1789061814.446085:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130770432:12345-0@lo:400: Request processed in 26us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.446091:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789061814.446109:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789061814.446115:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130770944:12345-0@lo:400: 00000100:00100000:0.0:1789061814.446139:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130770944:12345-0@lo:400: Request processed in 25us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.446144:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789061814.446153:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789061814.446158:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130770048:12345-0@lo:400: 00000100:00100000:0.0:1789061814.446180:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130770048:12345-0@lo:400: Request processed in 22us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.446186:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789061814.446206:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130770176 00000100:00100000:0.0:1789061814.446209:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130770176 00000100:00100000:0.0:1789061814.446229:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130769920 00000100:00100000:0.0:1789061814.446231:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130769920 00000100:00100000:0.0:1789061814.446241:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789061814.446246:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130770176:12345-0@lo:400: 00000100:00100000:0.0:1789061814.446274:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130770176:12345-0@lo:400: Request processed in 27us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.446279:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789061814.446289:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789061814.446294:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130769920:12345-0@lo:400: 00000100:00100000:0.0:1789061814.446319:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130769920:12345-0@lo:400: Request processed in 25us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.446324:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789061814.446338:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130770688 00000100:00100000:0.0:1789061814.446342:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130770688 00000100:00100000:0.0:1789061814.446363:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130770560 00000100:00100000:0.0:1789061814.446371:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130770560 00000100:00100000:0.0:1789061814.446392:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789061814.446398:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130770688:12345-0@lo:400: 00000100:00100000:0.0:1789061814.446426:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130770688:12345-0@lo:400: Request processed in 29us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.446432:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789061814.446443:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789061814.446448:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130770560:12345-0@lo:400: 00000100:00100000:0.0:1789061814.446473:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130770560:12345-0@lo:400: Request processed in 25us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.446478:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789061814.446502:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130771072 00000100:00100000:0.0:1789061814.446506:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130771072 00000100:00100000:0.0:1789061814.446526:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789061814.446533:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130771072:12345-0@lo:501: 00000100:00100000:0.0:1789061814.446664:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130771072:12345-0@lo:501: Request processed in 131us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.446671:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1789061814.446693:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789061814.446697:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789061814.446700:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061814.446724:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130770176:0@lo:400: 00010000:00080000:0.0:1789061814.446750:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f7ecdf80 x1875967130770688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.446761:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130770688:0@lo:400: 00010000:00080000:0.0:1789061814.446771:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd51d500 x1875967130769792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.446794:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130769792:0@lo:400: 00010000:00080000:0.0:1789061814.446807:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd51dc00 x1875967130770304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.446814:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130770304:0@lo:400: 00010000:00080000:0.0:1789061814.446822:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f7ecd880 x1875967130770816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.446829:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130770816:0@lo:400: 00010000:00080000:0.0:1789061814.446864:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd51f100 x1875967130770048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.446872:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130770048:0@lo:400: 00010000:00080000:0.0:1789061814.446881:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd51fb80 x1875967130770560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.446888:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130770560:0@lo:400: 00000100:00100000:0.0:1789061814.446897:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130769920:0@lo:400: 00010000:00080000:0.0:1789061814.446906:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd51f800 x1875967130770432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.446914:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130770432:0@lo:400: 00010000:00080000:0.0:1789061814.446923:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c56fdf80 x1875967130770944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.446931:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130770944:0@lo:400: 00000100:00100000:0.0:1789061814.446966:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130771072:0@lo:501: 00000100:00100000:0.0:1789061814.447007:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130771200:0@lo:503: 00000100:00100000:0.0:1789061814.447047:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.447061:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa900 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.447074:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130771200 00000100:00100000:0.0:1789061814.447078:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130771200 00000100:00100000:0.0:1789061814.447101:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789061814.447107:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130771200:12345-0@lo:503: 00000100:00100000:0.0:1789061814.447191:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130771200:12345-0@lo:503: Request processed in 84us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.447197:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789061814.447235:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130771200:0@lo:503: 00000100:00100000:0.0:1789061814.447397:0:9793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9793:1875967130771328:0@lo:502: 00000100:00100000:0.0:1789061814.447429:0:9793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.447447:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130771328 00000100:00100000:0.0:1789061814.447450:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130771328 00000100:00100000:0.0:1789061814.447470:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789061814.447475:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9793:x1875967130771328:12345-0@lo:502: 00000100:00100000:0.0:1789061814.447534:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9793:x1875967130771328:12345-0@lo:502: Request processed in 58us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.447539:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789061814.447566:0:9793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.447576:0:9793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9793:1875967130771328:0@lo:502: 00000100:00100000:0.0:1789061814.447632:0:9793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9793:1875967130771456:0@lo:502: 00000100:00100000:0.0:1789061814.447663:0:9793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.447680:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130771456 00000100:00100000:0.0:1789061814.447689:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130771456 00000100:00100000:0.0:1789061814.447709:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789061814.447715:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9793:x1875967130771456:12345-0@lo:502: 00000100:00100000:0.0:1789061814.452099:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:9793:x1875967130771456:12345-0@lo:502: Request processed in 4374us (4426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.452113:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789061814.452178:0:9793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.452204:0:9793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9793:1875967130771456:0@lo:502: 00000040:00080000:0.0:1789061814.452241:0:9793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789061814.452407:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789061814.452431:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789061814.452453:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6678 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.452465:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6678 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061814.452474:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789061814.452476:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789061814.452479:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789061814.452509:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.452517:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.452526:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061814.452543:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130771584:0@lo:101: 00000100:00100000:1.0:1789061814.452760:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061814.452789:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d01923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.453595:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130771584 00000100:00100000:0.0:1789061814.453617:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130771584 00000100:00100000:0.0:1789061814.453716:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789061814.453736:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130771584:12345-0@lo:101: 00010000:00010000:0.0:1789061814.453749:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061814.453766:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc667f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061814.453789:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc667f expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061814.453801:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc667f expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061814.453809:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031c00, rc 0) 00000100:00100000:0.0:1789061814.453861:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130771584:12345-0@lo:101: Request processed in 135us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.453867:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789061814.454715:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130771584:0@lo:101: 00010000:00010000:1.0:1789061814.454747:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6686 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061814.454758:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6686 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061814.454834:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd345c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130771712:0@lo:501: 00000100:00100000:1.0:1789061814.454876:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061814.454908:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.454982:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130771712 00000100:00100000:0.0:1789061814.454995:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130771712 00000100:00100000:0.0:1789061814.455026:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789061814.455034:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130771712:12345-0@lo:501: 00000100:00100000:0.0:1789061814.455158:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130771712:12345-0@lo:501: Request processed in 125us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.455165:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789061814.455391:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd345c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130771712:0@lo:501: 00000100:00100000:2.0:1789061814.455422:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130771840:0@lo:503: 00000100:00100000:2.0:1789061814.455462:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.455482:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d01923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.455554:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130771840 00000100:00100000:0.0:1789061814.455559:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130771840 00000100:00100000:0.0:1789061814.455590:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789061814.455597:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130771840:12345-0@lo:503: 00000100:00100000:0.0:1789061814.455718:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130771840:12345-0@lo:503: Request processed in 121us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.455736:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789061814.456097:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130771840:0@lo:503: 00000100:00100000:3.0:1789061814.456273:0:9794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9794:1875967130771968:0@lo:502: 00000100:00100000:3.0:1789061814.456310:0:9794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.456337:0:9794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d02e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.456651:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130771968 00000100:00100000:0.0:1789061814.456657:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130771968 00000100:00100000:0.0:1789061814.456761:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789061814.456768:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9794:x1875967130771968:12345-0@lo:502: 00000100:00100000:0.0:1789061814.456858:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9794:x1875967130771968:12345-0@lo:502: Request processed in 90us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.456865:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789061814.457117:0:9794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9794:1875967130771968:0@lo:502: 00000020:01000000:3.0:1789061814.457141:0:9794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061814.457149:0:9794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061814.457151:0:9794:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789061814.457158:0:9794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789061814.457160:0:9794:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789061814.457177:0:9794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9794:1875967130772096:0@lo:502: 00000100:00100000:3.0:1789061814.457212:0:9794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.457272:0:9794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d02e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.457418:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130772096 00000100:00100000:0.0:1789061814.457423:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130772096 00000100:00100000:3.0:1789061814.460207:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789061814.460219:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9794:x1875967130772096:12345-0@lo:502: 00000100:00100000:3.0:1789061814.460386:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:9794:x1875967130772096:12345-0@lo:502: Request processed in 168us (3173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061814.460392:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789061814.460811:0:9794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9794:1875967130772096:0@lo:502: 00000020:01000000:3.0:1789061814.460843:0:9794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061814.460851:0:9794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061814.460859:0:9794:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789061814.460865:0:9794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789061814.461043:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789061814.461067:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789061814.461078:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6686 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061814.461089:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6686 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061814.461106:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789061814.461109:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767fb057800 from 39 10000000:01000000:0.0:1789061814.461111:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789061814.461142:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061814.461150:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061814.461159:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061814.461177:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130772224:0@lo:101: 00000100:00100000:0.0:1789061814.461215:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.461282:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9840240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061814.461310:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130772224 00000100:00100000:3.0:1789061814.461317:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130772224 00000100:00100000:3.0:1789061814.461375:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789061814.461383:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130772224:12345-0@lo:101: 00010000:00010000:3.0:1789061814.461391:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061814.461403:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc668d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.461423:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc668d expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.461435:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc668d expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.461443:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3799c00, rc 0) 00000100:00100000:3.0:1789061814.461492:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130772224:12345-0@lo:101: Request processed in 110us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061814.461498:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789061814.461846:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130772224:0@lo:101: 00010000:00010000:3.0:1789061814.461859:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6694 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.461868:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6694 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061814.461917:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130772352:0@lo:501: 00000100:00100000:3.0:1789061814.461944:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.462006:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d02e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.462051:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130772352 00000100:00100000:0.0:1789061814.462055:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130772352 00000100:00100000:3.0:1789061814.462167:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789061814.462174:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130772352:12345-0@lo:501: 00000100:00100000:3.0:1789061814.462282:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130772352:12345-0@lo:501: Request processed in 108us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061814.462288:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789061814.462353:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130772352:0@lo:501: 00000100:00100000:3.0:1789061814.462377:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130772480:0@lo:503: 00000100:00100000:3.0:1789061814.462413:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.462463:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d02e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.462815:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130772480 00000100:00100000:0.0:1789061814.462820:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130772480 00000100:00100000:3.0:1789061814.462949:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789061814.462957:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130772480:12345-0@lo:503: 00000100:00100000:3.0:1789061814.463033:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130772480:12345-0@lo:503: Request processed in 78us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061814.463039:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789061814.463130:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130772480:0@lo:503: 00000100:00100000:3.0:1789061814.463440:0:9795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9795:1875967130772608:0@lo:502: 00000100:00100000:3.0:1789061814.463836:0:9795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.463864:0:9795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7482240 going to sleep for 11 seconds 00000100:00100000:2.0:1789061814.465378:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130772608 00000100:00100000:2.0:1789061814.465388:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130772608 00000100:00100000:2.0:1789061814.465529:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789061814.465539:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:9795:x1875967130772608:12345-0@lo:502: 00000100:00100000:2.0:1789061814.465711:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:9795:x1875967130772608:12345-0@lo:502: Request processed in 173us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061814.465738:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789061814.465763:0:9795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9795:1875967130772608:0@lo:502: 00000100:00100000:3.0:1789061814.465826:0:9795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9795:1875967130772736:0@lo:502: 00000100:00100000:3.0:1789061814.465866:0:9795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.479662:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130772736 00000100:00100000:0.0:1789061814.479677:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130772736 00000100:00100000:0.0:1789061814.479747:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789061814.479758:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:9795:x1875967130772736:12345-0@lo:502: 00000100:00100000:0.0:1789061814.479918:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:9795:x1875967130772736:12345-0@lo:502: Request processed in 160us (14049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.479926:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789061814.480262:0:9795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7482240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061814.480290:0:9795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9795:1875967130772736:0@lo:502: 00000040:00080000:3.0:1789061814.480335:0:9795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789061814.482514:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789061814.482552:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789061814.482563:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6694 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.482576:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6694 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061814.482587:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789061814.482590:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767fb057800 from 6 10000000:01000000:2.0:1789061814.482592:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789061814.482663:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.482672:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.482683:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061814.482705:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130772864:0@lo:101: 00000100:00100000:2.0:1789061814.482777:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.482815:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d0192cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061814.491078:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130772864 00000100:00100000:1.0:1789061814.491093:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130772864 00000100:00100000:1.0:1789061814.491146:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789061814.491156:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130772864:12345-0@lo:101: 00010000:00010000:1.0:1789061814.491173:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061814.491207:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47a400/0x2774d8f311dc66a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc669b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061814.491234:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47a400/0x2774d8f311dc66a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc669b expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061814.491243:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47a400/0x2774d8f311dc66a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc669b expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061814.491251:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a400, rc 0) 00000100:00100000:1.0:1789061814.491325:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130772864:12345-0@lo:101: Request processed in 170us (8548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061814.491332:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789061814.491383:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130772864:0@lo:101: 00010000:00010000:1.0:1789061814.491401:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061814.491411:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061814.491471:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130772992:0@lo:256: 00000100:00100000:1.0:1789061814.491507:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061814.491536:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736840 going to sleep for 11 seconds 00000100:00100000:1.0:1789061814.491549:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130772992 00000100:00100000:1.0:1789061814.491553:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130772992 00000100:00100000:1.0:1789061814.491575:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789061814.491582:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130772992:12345-0@lo:256: 20000000:01000000:1.0:1789061814.491596:0:6491:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789061814.491636:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789061814.491644:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789061814.491712:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130772992:12345-0@lo:256: Request processed in 130us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061814.491718:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789061814.492244:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130772992:0@lo:256: 10000000:01000000:1.0:1789061814.492290:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789061814.492298:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061814.492307:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061814.492315:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789061814.492317:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1789061814.492320:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789061814.492341:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061814.492348:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061814.492356:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061814.492368:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130773120:0@lo:101: 00000100:00100000:1.0:1789061814.492407:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061814.492474:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736840 going to sleep for 11 seconds 00000100:00100000:2.0:1789061814.499137:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130773120 00000100:00100000:2.0:1789061814.499151:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130773120 00000100:00100000:3.0:1789061814.504197:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789061814.504210:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130773120:12345-0@lo:101: 00010000:00010000:3.0:1789061814.504227:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061814.504245:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c3798600/0x2774d8f311dc66b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc66a9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.504273:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c3798600/0x2774d8f311dc66b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc66a9 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.504283:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c3798600/0x2774d8f311dc66b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc66a9 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.504290:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3798600, rc 0) 00000100:00100000:3.0:1789061814.504363:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130773120:12345-0@lo:101: Request processed in 156us (11956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061814.504370:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789061814.504911:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130773120:0@lo:101: 00010000:00010000:2.0:1789061814.504933:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.504956:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc66b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061814.505029:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130773248:0@lo:501: 00000100:00100000:2.0:1789061814.505065:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.505095:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d01920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061814.505161:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130773248 00000100:00100000:1.0:1789061814.505168:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130773248 00000100:00100000:1.0:1789061814.505234:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789061814.505248:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130773248:12345-0@lo:501: 00000100:00100000:1.0:1789061814.505363:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130773248:12345-0@lo:501: Request processed in 116us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061814.505369:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789061814.505393:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130773248:0@lo:501: 00000100:00100000:1.0:1789061814.505418:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd347800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130773376:0@lo:503: 00000100:00100000:1.0:1789061814.505451:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061814.505459:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789061814.505473:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130773376 00000100:00100000:1.0:1789061814.505477:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130773376 00000100:00100000:1.0:1789061814.505492:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789061814.505497:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130773376:12345-0@lo:503: 00000100:00100000:1.0:1789061814.505570:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130773376:12345-0@lo:503: Request processed in 72us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061814.505577:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789061814.505627:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd347800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130773376:0@lo:503: 00000100:00100000:3.0:1789061814.511272:0:9796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9796:1875967130773504:0@lo:502: 00000100:00100000:3.0:1789061814.511354:0:9796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.511396:0:9796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c74823c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061814.515827:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130773504 00000100:00100000:2.0:1789061814.515842:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130773504 00000100:00100000:2.0:1789061814.515907:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789061814.515916:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:9796:x1875967130773504:12345-0@lo:502: 00000100:00100000:2.0:1789061814.516080:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:9796:x1875967130773504:12345-0@lo:502: Request processed in 165us (4726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061814.516088:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789061814.520816:0:9796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9796:1875967130773504:0@lo:502: 00000020:01000000:3.0:1789061814.520865:0:9796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789061814.520873:0:9796:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789061814.520884:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061814.520886:0:9796:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789061814.520894:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789061814.520899:0:9796:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:3.0:1789061814.520924:0:9796:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789061814.520937:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789061814.520953:0:9796:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9766c71e3380) 00000020:00000080:3.0:1789061814.520978:0:9796:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1789061814.520984:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789061814.521086:0:9796:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789061814.521093:0:9796:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789061814.521100:0:9796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2774d8f311dc66be 00010000:00080000:3.0:1789061814.521129:0:9796:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767fb28c000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1789061814.521351:0:9796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1789061814.521479:0:9796:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789061814.521490:0:9796:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789061814.521844:0:9796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061814.521959:0:9796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061814.522101:0:9796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789061814.522184:0:9796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000020:00000080:1.0:1789061814.525952:0:9796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789061814.525967:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789061814.526006:0:9796:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789061814.526032:0:9796:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc66c5 00000100:00080000:1.0:1789061814.526043:0:9796:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789061814.526054:0:9796:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9767fb28c000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789061814.526089:0:9796:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9767fd347800 x1875967130773632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789061814.526118:0:9796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789061814.526169:0:9796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061814.526183:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061814.526185:0:9796:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789061814.526189:0:9796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061814.526193:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061814.526194:0:9796:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789061814.526197:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789061814.526199:0:9796:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789061814.526226:0:9796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9796:1875967130773760:0@lo:502: 00000100:00100000:1.0:1789061814.526298:0:9796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061814.526334:0:9796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736300 going to sleep for 11 seconds 00000100:00100000:1.0:1789061814.526353:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130773760 00000100:00100000:1.0:1789061814.526359:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130773760 00000100:00100000:1.0:1789061814.526393:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789061814.526401:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:9796:x1875967130773760:12345-0@lo:502: 00000100:00100000:1.0:1789061814.526512:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:9796:x1875967130773760:12345-0@lo:502: Request processed in 111us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061814.526519:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789061814.526569:0:9796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9796:1875967130773760:0@lo:502: 00000020:01000000:1.0:1789061814.526594:0:9796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061814.526598:0:9796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061814.526599:0:9796:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789061814.526603:0:9796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1789061814.526738:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1789061814.526763:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789061814.526772:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061814.526782:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061814.526804:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789061814.526807:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767c3163000 from 39 10000000:01000000:1.0:1789061814.526809:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789061814.526831:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061814.526839:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061814.526848:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061814.526860:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130773888:0@lo:101: 00000100:00100000:1.0:1789061814.526886:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.526951:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130773632:0@lo:8: 00000100:00100000:3.0:1789061814.526985:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061814.530941:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736300 going to sleep for 11 seconds 00000040:00080000:1.0:1789061814.534896:0:9799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061814.534906:0:9799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1789061814.536706:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130773888 00000100:00100000:2.0:1789061814.536719:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130773888 00000100:00100000:2.0:1789061814.536798:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789061814.536809:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130773888:12345-0@lo:101: 00010000:00010000:2.0:1789061814.536825:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061814.536843:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c1482600/0x2774d8f311dc66d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc66cc expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.536869:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1482600/0x2774d8f311dc66d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc66cc expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.536880:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c1482600/0x2774d8f311dc66d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc66cc expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.536905:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c1482600, rc 0) 00000100:00100000:2.0:1789061814.536985:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130773888:12345-0@lo:101: Request processed in 178us (10097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061814.536991:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789061814.537064:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130773888:0@lo:101: 00010000:00010000:2.0:1789061814.537083:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.537093:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc66d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061814.537170:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130774016:0@lo:501: 00000100:00100000:2.0:1789061814.537200:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.537218:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d01920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061814.537229:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130774016 00000100:00100000:2.0:1789061814.537232:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130774016 00000100:00100000:1.0:1789061814.537469:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789061814.537479:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130774016:12345-0@lo:501: 00000100:00100000:1.0:1789061814.537596:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130774016:12345-0@lo:501: Request processed in 119us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061814.537602:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789061814.537705:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130774016:0@lo:501: 00000100:00100000:2.0:1789061814.537745:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130774144:0@lo:503: 00000100:00100000:2.0:1789061814.537784:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.537898:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d01920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061814.540161:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130774144 00000100:00100000:1.0:1789061814.540174:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130774144 00000100:00100000:1.0:1789061814.540254:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789061814.540264:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130774144:12345-0@lo:503: 00000100:00100000:1.0:1789061814.540406:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130774144:12345-0@lo:503: Request processed in 143us (2620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061814.540420:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789061814.540516:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130774144:0@lo:503: 00000100:00100000:3.0:1789061814.540891:0:9801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9801:1875967130774272:0@lo:502: 00000100:00100000:3.0:1789061814.540931:0:9801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.540959:0:9801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c74826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061814.541004:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130774272 00000100:00100000:1.0:1789061814.541010:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130774272 00000100:00100000:1.0:1789061814.541029:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789061814.541035:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:9801:x1875967130774272:12345-0@lo:502: 00000100:00100000:1.0:1789061814.541118:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:9801:x1875967130774272:12345-0@lo:502: Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061814.541125:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789061814.541194:0:9801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9801:1875967130774272:0@lo:502: 00000100:00100000:3.0:1789061814.541235:0:9801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9801:1875967130774400:0@lo:502: 00000100:00100000:3.0:1789061814.541265:0:9801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.541285:0:9801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c74826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061814.541327:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130774400 00000100:00100000:1.0:1789061814.541331:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130774400 00000100:00100000:1.0:1789061814.541347:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789061814.541353:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:9801:x1875967130774400:12345-0@lo:502: 00000100:00100000:1.0:1789061814.541455:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:9801:x1875967130774400:12345-0@lo:502: Request processed in 101us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061814.541462:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789061814.543237:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130773632 00000100:00100000:0.0:1789061814.543248:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130773632 00000100:00100000:0.0:1789061814.543303:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789061814.543310:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3619:x1875967130773632:12345-0@lo:8: 00010000:00080000:0.0:1789061814.543341:0:8613:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1789061814.543369:0:8613:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc66da 00002000:00100000:0.0:1789061814.543383:0:8613:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9766c1584800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789061814.543387:0:8613:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1789061814.543392:0:8613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789061814.543450:0:8613:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789061814.543714:0:8613:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789061814.543753:0:8613:0:(import.c:65:import_set_state_nolock()) ffff9767fd65d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789061814.543832:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1875967130773632:12345-0@lo:8: Request processed in 521us (16846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.543840:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789061814.546299:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd347800 x1875967130773632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789061824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061814.546314:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789061814.546322:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789061814.546330:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789061814.546346:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789061814.546350:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fb28c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789061814.546371:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789061814.546378:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130773632:0@lo:8: 00000100:00100000:1.0:1789061814.546477:0:9800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd347b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875967130774528:0@lo:700: 00000100:00100000:1.0:1789061814.546532:0:9800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061814.546575:0:9800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736cc0 going to sleep for 11 seconds 00000004:00080000:1.0:1789061814.546590:0:9799:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789061814.546701:0:9799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 195656094054ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789061814.546707:0:9799:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789061814.546881:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130774528 00000100:00100000:2.0:1789061814.546887:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130774528 00000100:00100000:2.0:1789061814.546938:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061814.546947:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9800:x1875967130774528:12345-0@lo:700: 00000100:00100000:2.0:1789061814.546980:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8420:1875967130774656:0@lo:700: 00000100:00100000:2.0:1789061814.547011:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.547028:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d01923c0 going to sleep for 11 seconds 00000100:00080000:2.0:1789061814.547040:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061814.547056:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130774656 00000100:00100000:2.0:1789061814.547059:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130774656 00000100:00100000:2.0:1789061814.547081:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789061814.547087:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8420:x1875967130774656:12345-0@lo:700: 00000100:00100000:3.0:1789061814.547265:0:9801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9801:1875967130774400:0@lo:502: 00000040:00080000:3.0:1789061814.547543:0:9801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789061814.547724:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789061814.547760:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789061814.547770:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.547782:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061814.547791:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789061814.547794:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767c3163000 from 6 10000000:01000000:2.0:1789061814.547797:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789061814.547820:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.547834:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.547844:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061814.547857:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130774784:0@lo:101: 00000100:00100000:2.0:1789061814.547893:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.547923:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d0192a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061814.547973:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130774784 00000100:00100000:3.0:1789061814.547978:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130774784 00000100:00100000:3.0:1789061814.548014:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789061814.548021:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130774784:12345-0@lo:101: 00010000:00010000:3.0:1789061814.548030:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061814.548041:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c3798e00/0x2774d8f311dc66e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc66e1 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.548061:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c3798e00/0x2774d8f311dc66e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc66e1 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.548071:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c3798e00/0x2774d8f311dc66e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc66e1 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.548080:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3798e00, rc 0) 00000100:00100000:3.0:1789061814.548115:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130774784:12345-0@lo:101: Request processed in 95us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061814.548123:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789061814.548193:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130774784:0@lo:101: 00010000:00010000:2.0:1789061814.548205:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.548214:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061814.548252:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130774912:0@lo:256: 00000100:00100000:2.0:1789061814.548280:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.548301:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d0192a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061814.548345:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130774912 00000100:00100000:3.0:1789061814.548349:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130774912 00000100:00100000:3.0:1789061814.548376:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789061814.548383:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130774912:12345-0@lo:256: 20000000:01000000:3.0:1789061814.548395:0:6491:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789061814.548409:0:6491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789061814.548412:0:6491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789061814.548479:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130774912:12345-0@lo:256: Request processed in 96us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061814.548486:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789061814.548512:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130774912:0@lo:256: 10000000:01000000:3.0:1789061814.548552:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789061814.548557:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.548565:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061814.548573:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789061814.548575:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789061814.548577:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789061814.548590:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.548598:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.548625:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061814.548636:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130775040:0@lo:101: 00000100:00100000:3.0:1789061814.548659:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.548671:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7482300 going to sleep for 11 seconds 00000100:00100000:3.0:1789061814.548682:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130775040 00000100:00100000:3.0:1789061814.548685:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130775040 00000100:00100000:3.0:1789061814.548704:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789061814.548710:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130775040:12345-0@lo:101: 00010000:00010000:3.0:1789061814.548716:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061814.548723:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc66f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc66ef expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.548761:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc66f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc66ef expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.548770:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc66f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc66ef expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.548777:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3799a00, rc 0) 00000100:00100000:3.0:1789061814.548803:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130775040:12345-0@lo:101: Request processed in 93us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061814.548809:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789061814.548835:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130775040:0@lo:101: 00010000:00010000:3.0:1789061814.548844:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061814.548852:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc66f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061814.548896:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130775168:0@lo:501: 00000100:00100000:3.0:1789061814.548917:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.548927:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7482300 going to sleep for 11 seconds 00000100:00100000:3.0:1789061814.548937:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130775168 00000100:00100000:3.0:1789061814.548941:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130775168 00000100:00100000:3.0:1789061814.548958:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789061814.548964:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130775168:12345-0@lo:501: 00000100:00100000:3.0:1789061814.549056:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130775168:12345-0@lo:501: Request processed in 91us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061814.549062:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789061814.549554:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130775168:0@lo:501: 00000100:00100000:3.0:1789061814.549581:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130775296:0@lo:503: 00000100:00100000:3.0:1789061814.549640:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.549660:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7482300 going to sleep for 11 seconds 00000100:00100000:2.0:1789061814.549758:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130775296 00000100:00100000:2.0:1789061814.549763:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130775296 00000100:00100000:2.0:1789061814.549793:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789061814.549799:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130775296:12345-0@lo:503: 00000100:00100000:2.0:1789061814.549891:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130775296:12345-0@lo:503: Request processed in 92us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061814.549898:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789061814.549984:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130775296:0@lo:503: 00000100:00100000:3.0:1789061814.550308:0:9802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9802:1875967130775424:0@lo:502: 00000100:00100000:3.0:1789061814.550341:0:9802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.550368:0:9802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7482b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789061814.550408:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130775424 00000100:00100000:1.0:1789061814.550412:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130775424 00000100:00100000:1.0:1789061814.550442:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789061814.550448:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:9802:x1875967130775424:12345-0@lo:502: 00000100:00100000:1.0:1789061814.550541:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:9802:x1875967130775424:12345-0@lo:502: Request processed in 93us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061814.550548:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789061814.550640:0:9802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9802:1875967130775424:0@lo:502: 00000020:01000000:3.0:1789061814.550662:0:9802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789061814.550669:0:9802:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789061814.550676:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061814.550678:0:9802:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789061814.550683:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789061814.550687:0:9802:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:3.0:1789061814.550708:0:9802:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789061814.550711:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789061814.550736:0:9802:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9766c71e4d40) 00000020:00000080:3.0:1789061814.550767:0:9802:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789061814.550774:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789061814.550851:0:9802:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789061814.550856:0:9802:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789061814.550864:0:9802:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc6704 00010000:00080000:3.0:1789061814.550891:0:9802:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9766c75b7000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1789061814.551119:0:9802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1789061814.551233:0:9802:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789061814.551244:0:9802:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789061814.551406:0:9802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061814.551518:0:9802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789061814.551690:0:9802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789061814.551797:0:9802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789061814.558169:0:9803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789061814.558177:0:9803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789061814.558800:0:9802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789061814.558811:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789061814.558845:0:9802:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789061814.558868:0:9802:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc670b 00000100:00080000:2.0:1789061814.558877:0:9802:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789061814.558887:0:9802:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9766c75b7000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789061814.558920:0:9802:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c6768000 x1875967130775552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789061814.558941:0:9802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789061814.558987:0:9802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061814.558992:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061814.558994:0:9802:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789061814.558996:0:9802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061814.559000:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061814.559001:0:9802:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789061814.559004:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789061814.559006:0:9802:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789061814.559032:0:9802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9802:1875967130775680:0@lo:502: 00000100:00100000:2.0:1789061814.559102:0:9802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.559135:0:9802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789061814.559222:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130775552:0@lo:8: 00000100:00100000:3.0:1789061814.559266:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061814.559312:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130775680 00000100:00100000:3.0:1789061814.559319:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130775680 00000100:00100000:3.0:1789061814.559357:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789061814.559365:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:9802:x1875967130775680:12345-0@lo:502: 00000100:00100000:3.0:1789061814.559465:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:9802:x1875967130775680:12345-0@lo:502: Request processed in 100us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061814.559472:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789061814.559550:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130775552 00000100:00100000:2.0:1789061814.559555:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130775552 00000100:00100000:2.0:1789061814.559584:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789061814.559589:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875967130775552:12345-0@lo:8: 00010000:00080000:2.0:1789061814.559628:0:8411:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:2.0:1789061814.559650:0:8411:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc6712 00002000:00100000:2.0:1789061814.559662:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9766c717f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789061814.559666:0:8411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789061814.559674:0:8411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789061814.559743:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789061814.559764:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9766c7178000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061814.559798:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875967130775552:12345-0@lo:8: Request processed in 207us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061814.559804:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789061814.559834:0:9802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:9802:1875967130775680:0@lo:502: 00000020:01000000:2.0:1789061814.559857:0:9802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061814.559862:0:9802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061814.559863:0:9802:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789061814.559866:0:9802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1789061814.559964:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1789061814.559988:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789061814.559997:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.560007:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061814.560018:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789061814.560020:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9767f38a8000 from 1 10000000:01000000:2.0:1789061814.560023:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789061814.560047:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.560056:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.560065:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061814.560088:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130775808:0@lo:101: 00000100:00100000:2.0:1789061814.560116:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.560136:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9dc80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061814.560148:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130775808 00000100:00100000:2.0:1789061814.560152:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130775808 00000100:00100000:2.0:1789061814.560177:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789061814.560183:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130775808:12345-0@lo:101: 00010000:00010000:2.0:1789061814.560190:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061814.560212:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6719 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.560234:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6719 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.560245:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6719 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.560254:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c74da200, rc 0) 00000100:00100000:2.0:1789061814.560280:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130775808:12345-0@lo:101: Request processed in 98us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061814.560287:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789061814.560314:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130775808:0@lo:101: 00010000:00010000:2.0:1789061814.560326:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6720 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.560335:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6720 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061814.560387:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130775936:0@lo:501: 00000100:00100000:2.0:1789061814.560410:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.560422:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9dc80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061814.560433:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130775936 00000100:00100000:2.0:1789061814.560436:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130775936 00000100:00100000:2.0:1789061814.560455:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789061814.560461:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130775936:12345-0@lo:501: 00000100:00100000:2.0:1789061814.560519:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130775936:12345-0@lo:501: Request processed in 58us (108us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789061814.560525:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789061814.560549:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130775936:0@lo:501: 10000000:01000000:2.0:1789061814.560567:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789061814.560572:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6720 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061814.560578:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6720 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789061814.561304:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6768000 x1875967130775552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789061824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061814.561317:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789061814.561324:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789061814.561331:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789061814.561336:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789061814.561339:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9766c75b7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789061814.561351:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789061814.561356:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130775552:0@lo:8: 00000004:00080000:3.0:1789061814.561376:0:9803:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789061814.561439:0:9803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 195670831993ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789061814.561445:0:9803:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789061814.561823:0:7427:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 40000000:02000000:3.0:1789061814.562089:0:6503:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000004:00080000:0.0:1789061814.574313:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789061814.574415:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130776064:0@lo:13: 00000100:00100000:0.0:1789061814.574482:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.574538:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130776064 00000100:00100000:0.0:1789061814.574546:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130776064 00000100:00100000:0.0:1789061814.574629:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789061814.574639:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875967130776064:12345-0@lo:13: 00002000:00000024:0.0:1789061814.574667:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1789061814.574708:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875967130776064:12345-0@lo:13: Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.574715:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789061814.574767:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7513b80 x1875967130776064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.574788:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130776064:0@lo:13: 00000004:00080000:0.0:1789061814.574816:0:9804:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789061814.574838:0:9804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875967130776192:0@lo:7: 00000100:00100000:0.0:1789061814.574865:0:9804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.574886:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130776192 00000100:00100000:0.0:1789061814.574890:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130776192 00000100:00100000:0.0:1789061814.574915:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789061814.574921:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9804:x1875967130776192:12345-0@lo:7: 00000100:00080000:2.0:1789061814.575703:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061814.580199:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8420:x1875967130774656:12345-0@lo:700: Request processed in 33106us (33182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061814.580221:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789061814.580281:0:8420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676b480 x1875967130774656/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789061830 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061814.580295:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8420:1875967130774656:0@lo:700: 40000000:02000000:3.0:1789061814.580309:0:8420:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00002000:00080000:0.0:1789061814.589798:0:8613:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789061814.589806:0:8613:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789061814.589877:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9804:x1875967130776192:12345-0@lo:7: Request processed in 14953us (15007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.589888:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789061814.589944:0:9804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9840b40 going to sleep for 11 seconds 00010000:00080000:0.0:1789061814.589970:0:9804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7513b80 x1875967130776192/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789061830 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.589986:0:9804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875967130776192:0@lo:7: 00000004:00080000:0.0:1789061814.590227:0:9804:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789061814.590265:0:9804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875967130776320:0@lo:5: 00000100:00100000:0.0:1789061814.590310:0:9804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.590391:0:9804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9840b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789061814.594517:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130776320 00000100:00100000:1.0:1789061814.594530:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130776320 00000001:00100000:3.0:1789061814.595176:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789061814.595182:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789061814.595353:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9800:x1875967130774528:12345-0@lo:700: Request processed in 48404us (48817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061814.595364:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789061814.595449:0:9800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd347b80 x1875967130774528/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789061830 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061814.595464:0:9800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd347b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875967130774528:0@lo:700: 00000100:00100000:0.0:1789061814.595688:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789061814.595697:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9804:x1875967130776320:12345-0@lo:5: 00002000:00080000:0.0:1789061814.595722:0:8411:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789061814.595737:0:8411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789061814.596002:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9804:x1875967130776320:12345-0@lo:5: Request processed in 305us (5691us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789061814.596020:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789061814.596048:0:9804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7513b80 x1875967130776320/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789061830 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.596060:0:9804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875967130776320:0@lo:5: 00000004:00080000:0.0:1789061814.596068:0:9804:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789061814.596097:0:9804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875967130776448:0@lo:700: 00000100:00100000:0.0:1789061814.596273:0:9804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.596306:0:9804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9840b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789061814.596352:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130776448 00000100:00100000:3.0:1789061814.596358:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130776448 00000100:00100000:3.0:1789061814.596389:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789061814.596396:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9804:x1875967130776448:12345-0@lo:700: 00000004:00080000:2.0:1789061814.605017:0:9800:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789061814.605048:0:9800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875967130776704:0@lo:7: 00000100:00100000:2.0:1789061814.605116:0:9800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.605155:0:9800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd3e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061814.605171:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061814.605183:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130776576:0@lo:13: 00000100:00100000:2.0:1789061814.605220:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.605251:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130776704 00000100:00100000:2.0:1789061814.605258:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130776704 00000100:00100000:2.0:1789061814.605303:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789061814.605311:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9800:x1875967130776704:12345-0@lo:7: 00000100:00100000:2.0:1789061814.609544:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130776576 00000100:00100000:2.0:1789061814.609556:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130776576 00000100:00100000:2.0:1789061814.609680:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789061814.609691:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875967130776576:12345-0@lo:13: 00002000:00000024:2.0:1789061814.609714:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789061814.609801:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875967130776576:12345-0@lo:13: Request processed in 113us (4580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061814.609808:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00002000:00080000:3.0:1789061814.610193:0:8413:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789061814.610199:0:8413:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789061814.610242:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9800:x1875967130776704:12345-0@lo:7: Request processed in 4931us (5126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061814.610249:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789061814.610387:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6769880 x1875967130776576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.610408:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130776576:0@lo:13: 00010000:00080000:2.0:1789061814.610822:0:9800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676b800 x1875967130776704/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789061830 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061814.610832:0:9800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875967130776704:0@lo:7: 00000004:00080000:2.0:1789061814.610842:0:9800:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789061814.610872:0:9800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875967130776832:0@lo:5: 00000100:00100000:2.0:1789061814.610904:0:9800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.610975:0:9800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd3e0e40 going to sleep for 11 seconds 00000001:00080000:3.0:1789061814.611045:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1789061814.611190:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9804:x1875967130776448:12345-0@lo:700: Request processed in 14794us (14917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061814.611199:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789061814.611430:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130776832 00000100:00100000:0.0:1789061814.611436:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130776832 00000100:00100000:0.0:1789061814.611516:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789061814.611525:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9800:x1875967130776832:12345-0@lo:5: 00002000:00080000:0.0:1789061814.611546:0:8411:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789061814.611589:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9800:x1875967130776832:12345-0@lo:5: Request processed in 66us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.611594:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789061814.611672:0:9800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676b800 x1875967130776832/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789061830 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061814.611683:0:9800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875967130776832:0@lo:5: 00000004:00080000:2.0:1789061814.611702:0:9800:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789061814.611734:0:9800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875967130776960:0@lo:5: 00000100:00100000:2.0:1789061814.611759:0:9800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061814.615011:0:9800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd3e0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789061814.619335:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130776960 00000100:00100000:3.0:1789061814.619349:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130776960 00000100:00100000:3.0:1789061814.619421:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789061814.619430:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9800:x1875967130776960:12345-0@lo:5: 00002000:00080000:3.0:1789061814.619471:0:8412:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00010000:00080000:0.0:1789061814.624252:0:9804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7511180 x1875967130776448/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789061830 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061814.624266:0:9804:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789061814.624282:0:9804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875967130776448:0@lo:700: 00000100:00100000:3.0:1789061814.625850:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9800:x1875967130776960:12345-0@lo:5: Request processed in 6416us (14085us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789061814.625861:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789061814.627930:0:9800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676b800 x1875967130776960/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789061830 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061814.627951:0:9800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9800:1875967130776960:0@lo:5: 00000004:00080000:1.0:1789061814.627967:0:9800:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789061814.628012:0:9800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd346680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9800:1875967130777088:0@lo:900: 00000100:00100000:1.0:1789061814.628065:0:9800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061814.628095:0:9800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736000 going to sleep for 11 seconds 00000100:00100000:1.0:1789061814.628199:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130777088 00000100:00100000:1.0:1789061814.628206:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130777088 00000100:00100000:1.0:1789061814.628249:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789061814.628257:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9800:x1875967130777088:12345-0@lo:900: 00000100:00100000:1.0:1789061814.628311:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9800:x1875967130777088:12345-0@lo:900: Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061814.628317:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789061814.628353:0:9800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd346680 x1875967130777088/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789061830 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061814.628362:0:9800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd346680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9800:1875967130777088:0@lo:900: 00000004:02000040:1.0:1789061814.629829:0:9804:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1789061814.646419:0:9804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd346680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875967130777216:0@lo:5: 00000100:00100000:1.0:1789061814.646494:0:9804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061814.646541:0:9804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061814.646769:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130777216 00000100:00100000:0.0:1789061814.646788:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130777216 00000100:00100000:0.0:1789061814.646842:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789061814.646852:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9804:x1875967130777216:12345-0@lo:5: 00002000:00080000:0.0:1789061814.655985:0:8411:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789061814.656004:0:8411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789061814.657960:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9804:x1875967130777216:12345-0@lo:5: Request processed in 11104us (11461us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789061814.657973:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789061814.661353:0:9804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd346680 x1875967130777216/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789061830 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061814.661373:0:9804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd346680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9804:1875967130777216:0@lo:5: 00000004:00080000:1.0:1789061814.661390:0:9804:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:3.0:1789061814.958132:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061814.958156:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130777344:0@lo:41: 00000100:00100000:3.0:1789061814.958218:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061814.961690:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130777344 00000100:00100000:0.0:1789061814.961702:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130777344 00000100:00100000:0.0:1789061814.961781:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789061814.961792:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130777344:12345-0@lo:41: 00000004:00000024:0.0:1789061814.961827:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789061814.961908:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130777344:12345-0@lo:41: Request processed in 118us (3688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061814.961915:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789061814.961967:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130777344:0@lo:41: 00010000:00010000:2.0:1789061815.082762:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789061815.560319:0:9862:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789061816.116522:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789061816.625533:0:9914:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789061816.626254:0:9914:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789061817.130920:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061817.518291:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061817.518327:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130777472:0@lo:41: 00000100:00100000:3.0:1789061817.518417:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061817.518494:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130777472 00000100:00100000:3.0:1789061817.518504:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130777472 00000100:00100000:3.0:1789061817.520249:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789061817.520269:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130777472:12345-0@lo:41: 00000004:00000024:3.0:1789061817.520316:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789061817.520408:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130777472:12345-0@lo:41: Request processed in 146us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061817.520415:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789061817.520492:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130777472:0@lo:41: 00000001:00080000:0.0:1789061817.681877:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1789061817.681897:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1789061818.025777:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789061818.025800:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130777728:0@lo:13: 00000100:00100000:0.0:1789061818.025885:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061818.025957:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130777600:0@lo:13: 00000100:00100000:0.0:1789061818.026040:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061818.026074:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130777728 00000100:00100000:0.0:1789061818.026081:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130777728 00000100:00080000:2.0:1789061818.026108:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061818.026120:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130777600 00000100:00100000:0.0:1789061818.026134:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130777600 00000100:00100000:0.0:1789061818.026166:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789061818.026176:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130777728:12345-0@lo:13: 00000100:00080000:2.0:1789061818.026189:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789061818.026203:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061818.026249:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130777728:12345-0@lo:13: Request processed in 75us (364us total) trans 0 rc 0/0 00010000:00080000:2.0:1789061818.026315:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd345500 x1875967130777728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061818.026332:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130777728:0@lo:13: 00000100:00100000:0.0:1789061818.030472:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789061818.030514:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789061818.030531:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130777600:12345-0@lo:13: 00002000:00000024:0.0:1789061818.030559:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061818.030653:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130777600:12345-0@lo:13: Request processed in 130us (4613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061818.030660:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789061818.030726:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7511180 x1875967130777600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061818.030748:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130777600:0@lo:13: 00010000:00010000:2.0:1789061818.154165:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061819.177871:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061819.570631:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130778240:0@lo:400: 00000100:00100000:3.0:1789061819.570714:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061819.570777:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130778752:0@lo:400: 00000100:00100000:3.0:1789061819.570803:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061819.570827:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130779264:0@lo:400: 00000100:00100000:3.0:1789061819.570845:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061819.570881:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789061819.570886:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130778112:0@lo:400: 00000100:00100000:3.0:1789061819.570921:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061819.570940:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130778624:0@lo:400: 00000100:00100000:3.0:1789061819.570960:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061819.570976:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb25b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130779136:0@lo:400: 00000100:00100000:3.0:1789061819.570998:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061819.571026:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130778240 00000100:00100000:3.0:1789061819.571033:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130778240 00000100:00100000:3.0:1789061819.571287:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130778624 00000100:00100000:3.0:1789061819.571291:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130778624 00000100:00100000:3.0:1789061819.571312:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130779136 00000100:00100000:3.0:1789061819.571315:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130779136 00000100:00100000:3.0:1789061819.571401:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789061819.571412:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130778240:12345-0@lo:400: 00000100:00100000:3.0:1789061819.571463:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130778240:12345-0@lo:400: Request processed in 53us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061819.571469:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789061819.571486:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789061819.571493:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130778624:12345-0@lo:400: 00000100:00100000:3.0:1789061819.571518:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130778624:12345-0@lo:400: Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061819.571523:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789061819.571535:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789061819.571540:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130779136:12345-0@lo:400: 00000100:00100000:3.0:1789061819.571564:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130779136:12345-0@lo:400: Request processed in 24us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061819.571578:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789061819.571597:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130778752 00000100:00100000:3.0:1789061819.571601:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130778752 00000100:00100000:3.0:1789061819.572167:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130779264 00000100:00100000:3.0:1789061819.572172:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130779264 00000100:00100000:3.0:1789061819.572199:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789061819.572206:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130778752:12345-0@lo:400: 00000100:00100000:3.0:1789061819.572241:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130778752:12345-0@lo:400: Request processed in 36us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061819.572248:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789061819.572259:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789061819.572265:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130779264:12345-0@lo:400: 00000100:00100000:3.0:1789061819.572287:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130779264:12345-0@lo:400: Request processed in 23us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061819.572293:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789061819.572472:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130777984:0@lo:400: 00000100:00100000:1.0:1789061819.572506:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061819.572527:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130778496:0@lo:400: 00000100:00100000:1.0:1789061819.572546:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061819.572559:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130779008:0@lo:400: 00000100:00100000:1.0:1789061819.572580:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061819.572596:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789061819.572626:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130777856:0@lo:400: 00000100:00100000:1.0:1789061819.572679:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061819.572714:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130778368:0@lo:400: 00000100:00100000:1.0:1789061819.572749:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061819.572765:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130778880:0@lo:400: 00000100:00100000:1.0:1789061819.572785:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061819.572799:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130779392:0@lo:400: 00000100:00100000:1.0:1789061819.572816:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061819.572840:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130778112 00000100:00100000:1.0:1789061819.572850:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130778112 00000100:00100000:1.0:1789061819.572876:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130778368 00000100:00100000:1.0:1789061819.572879:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130778368 00000100:00100000:1.0:1789061819.572892:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789061819.572898:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130778112:12345-0@lo:400: 00000100:00100000:1.0:1789061819.572929:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130778112:12345-0@lo:400: Request processed in 32us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061819.572935:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789061819.572949:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789061819.572954:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130778368:12345-0@lo:400: 00000100:00100000:1.0:1789061819.572980:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130778368:12345-0@lo:400: Request processed in 26us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061819.572985:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789061819.573001:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130778880 00000100:00100000:1.0:1789061819.573005:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130778880 00000100:00100000:1.0:1789061819.573019:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130779392 00000100:00100000:1.0:1789061819.573022:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130779392 00000100:00100000:1.0:1789061819.573035:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789061819.573051:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130778880:12345-0@lo:400: 00000100:00100000:1.0:1789061819.573343:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130778880:12345-0@lo:400: Request processed in 292us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061819.573350:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789061819.573364:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789061819.573370:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130779392:12345-0@lo:400: 00000100:00100000:1.0:1789061819.573395:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130779392:12345-0@lo:400: Request processed in 26us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061819.573401:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789061819.573487:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130777984 00000100:00100000:1.0:1789061819.573496:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130777984 00000100:00100000:1.0:1789061819.573519:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130778496 00000100:00100000:1.0:1789061819.573521:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130778496 00000100:00100000:1.0:1789061819.573533:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130779008 00000100:00100000:1.0:1789061819.573535:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130779008 00000100:00100000:1.0:1789061819.573547:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789061819.573553:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130777984:12345-0@lo:400: 00000100:00100000:1.0:1789061819.573582:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130777984:12345-0@lo:400: Request processed in 30us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061819.573588:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789061819.573598:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789061819.573622:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130778496:12345-0@lo:400: 00000100:00100000:1.0:1789061819.573648:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130778496:12345-0@lo:400: Request processed in 45us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061819.573664:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789061819.573676:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789061819.573682:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130779008:12345-0@lo:400: 00010000:00080000:3.0:1789061819.573974:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676d500 x1875967130778624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061819.573990:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130778624:0@lo:400: 00010000:00080000:3.0:1789061819.574008:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fb25b800 x1875967130779136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061819.574016:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb25b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130779136:0@lo:400: 00010000:00080000:3.0:1789061819.574028:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676dc00 x1875967130778240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061819.574036:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130778240:0@lo:400: 00000100:00100000:1.0:1789061819.574161:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130779008:12345-0@lo:400: Request processed in 478us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061819.574168:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789061819.574195:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130777856 00000100:00100000:1.0:1789061819.574199:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130777856 00000100:00100000:1.0:1789061819.574225:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789061819.574231:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130777856:12345-0@lo:400: 00000100:00100000:1.0:1789061819.574260:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130777856:12345-0@lo:400: Request processed in 29us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061819.574266:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789061819.574318:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130777856:0@lo:400: 00000100:00080000:2.0:1789061819.574438:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789061819.574443:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061819.574445:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789061819.574487:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676e680 x1875967130778752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061819.574503:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130778752:0@lo:400: 00010000:00080000:3.0:1789061819.574516:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fb258000 x1875967130779264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061819.574523:0:3621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789061819.574537:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130779264:0@lo:400: 00000100:00100000:3.0:1789061819.574560:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130778112:0@lo:400: 00000100:00100000:1.0:1789061819.574887:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130778368:0@lo:400: 00010000:00080000:1.0:1789061819.574907:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676c380 x1875967130778880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061819.574917:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130778880:0@lo:400: 00010000:00080000:1.0:1789061819.574927:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fb25bb80 x1875967130779392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061819.574934:0:3623:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789061819.574942:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130779392:0@lo:400: 00010000:00080000:1.0:1789061819.574953:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676e300 x1875967130777984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061819.574961:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130777984:0@lo:400: 00010000:00080000:1.0:1789061819.574970:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676ce00 x1875967130778496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061819.574978:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130778496:0@lo:400: 00010000:00080000:1.0:1789061819.574988:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676c000 x1875967130779008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061819.574995:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130779008:0@lo:400: 00000020:00000004:2.0:1789061819.985994:0:10016:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789061819.986284:0:10016:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789061820.075574:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130779520:0@lo:13: 00000100:00100000:1.0:1789061820.075667:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061820.075744:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130779648:0@lo:13: 00000100:00100000:1.0:1789061820.075770:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061820.075815:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130779520 00000100:00100000:1.0:1789061820.075822:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130779520 00000100:00100000:1.0:1789061820.075854:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130779648 00000100:00100000:1.0:1789061820.075856:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130779648 00000100:00100000:1.0:1789061820.075869:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789061820.075877:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130779520:12345-0@lo:13: 00002000:00000024:1.0:1789061820.075917:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061820.075962:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130779520:12345-0@lo:13: Request processed in 85us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061820.075968:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789061820.075985:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789061820.075991:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130779648:12345-0@lo:13: 00002000:00000024:1.0:1789061820.075999:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061820.076023:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130779648:12345-0@lo:13: Request processed in 33us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061820.076028:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789061820.076522:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd347b80 x1875967130779648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061820.076541:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130779648:0@lo:13: 00010000:00080000:1.0:1789061820.076572:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd346680 x1875967130779520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061820.077161:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130779520:0@lo:13: 00000100:00100000:2.0:1789061820.085805:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061820.085829:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130779776:0@lo:41: 00000100:00100000:2.0:1789061820.085907:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061820.085950:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130779776 00000100:00100000:2.0:1789061820.085957:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130779776 00000100:00100000:2.0:1789061820.085998:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789061820.086007:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130779776:12345-0@lo:41: 00000004:00000024:2.0:1789061820.086060:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789061820.086271:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130779776:12345-0@lo:41: Request processed in 264us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061820.086279:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789061820.086667:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130779776:0@lo:41: 00010000:00010000:2.0:1789061820.203401:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789061821.051040:0:10064:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789061821.051050:0:10064:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1789061821.233034:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061821.654318:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061821.655207:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120244864 00000100:00100000:0.0:1789061821.655218:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120244864 00000100:00100000:0.0:1789061821.655386:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 178 00000100:00100000:0.0:1789061821.655394:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2389:x1875967120244864:12345-192.168.203.3@tcp:250: 00010000:00080000:0.0:1789061821.655421:0:6491:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 21c8093b-edf9-482d-a900-a6298c53147f@192.168.203.3@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1789061821.655451:0:6491:0:(genops.c:1384:class_connect()) connect: client 21c8093b-edf9-482d-a900-a6298c53147f, cookie 0x2774d8f311dc6727 00000100:00080000:0.0:1789061821.655581:0:6491:0:(import.c:65:import_set_state_nolock()) ffff9767fd65a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789061821.655669:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+5:2389:x1875967120244864:12345-192.168.203.3@tcp:250: Request processed in 273us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061821.655686:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 178 00000100:00100000:1.0:1789061821.670528:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061821.670640:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120244992 00000100:00100000:2.0:1789061821.670651:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120244992 00000100:00100000:2.0:1789061821.670712:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 179 00000100:00100000:2.0:1789061821.670723:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+5:6150:x1875967120244992:12345-192.168.203.3@tcp:101: 00010000:00010000:2.0:1789061821.670739:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061821.670757:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c74dba00/0x2774d8f311dc672e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b6d6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061821.670794:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c74dba00/0x2774d8f311dc672e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6d6 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061821.670806:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c74dba00/0x2774d8f311dc672e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6d6 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061821.670815:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c74dba00, rc 0) 00000100:00100000:2.0:1789061821.670871:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+6:6150:x1875967120244992:12345-192.168.203.3@tcp:101: Request processed in 150us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061821.670877:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 179 00000100:00100000:3.0:1789061821.672928:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061821.673071:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120245120 00000100:00100000:0.0:1789061821.673079:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120245120 00000100:00100000:0.0:1789061821.673133:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:0.0:1789061821.673142:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+6:6150:x1875967120245120:12345-192.168.203.3@tcp:501: 00000100:00100000:0.0:1789061821.673259:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+6:6150:x1875967120245120:12345-192.168.203.3@tcp:501: Request processed in 118us (337us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789061821.673266:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:3.0:1789061821.688207:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061821.688645:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120245248 00000100:00100000:1.0:1789061821.688655:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120245248 00000100:00100000:1.0:1789061821.688713:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:1.0:1789061821.688735:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+6:6150:x1875967120245248:12345-192.168.203.3@tcp:101: 00010000:00010000:1.0:1789061821.688753:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061821.688771:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc6735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b6dd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061821.688808:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc6735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6dd expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061821.688818:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc6735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6dd expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061821.688827:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47aa00, rc 0) 00000100:00100000:1.0:1789061821.688880:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+7:6150:x1875967120245248:12345-192.168.203.3@tcp:101: Request processed in 148us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061821.688887:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:2.0:1789061821.698952:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061821.699048:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120245376 00000100:00100000:0.0:1789061821.699067:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120245376 00000100:00100000:0.0:1789061821.699132:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:0.0:1789061821.699142:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+7:6150:x1875967120245376:12345-192.168.203.3@tcp:501: 00000100:00100000:0.0:1789061821.699292:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+8:6150:x1875967120245376:12345-192.168.203.3@tcp:501: Request processed in 151us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061821.699299:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:3.0:1789061821.714497:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061821.714595:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120245504 00000100:00100000:0.0:1789061821.714637:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120245504 00000100:00100000:0.0:1789061821.714741:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:0.0:1789061821.714752:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+8:6150:x1875967120245504:12345-192.168.203.3@tcp:503: 00000100:00100000:0.0:1789061821.714902:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+8:6150:x1875967120245504:12345-192.168.203.3@tcp:503: Request processed in 151us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061821.714909:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:3.0:1789061821.728400:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061821.728491:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120245632 00000100:00100000:1.0:1789061821.728502:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120245632 00000100:00100000:1.0:1789061821.728564:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:1.0:1789061821.728575:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+8:6169:x1875967120245632:12345-192.168.203.3@tcp:502: 00000100:00100000:1.0:1789061821.728757:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+8:6169:x1875967120245632:12345-192.168.203.3@tcp:502: Request processed in 184us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061821.728766:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:3.0:1789061821.798791:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061821.799021:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120245760 00000100:00100000:0.0:1789061821.799030:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120245760 00000100:00100000:0.0:1789061821.799100:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 185 00000100:00100000:0.0:1789061821.799112:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+8:6169:x1875967120245760:12345-192.168.203.3@tcp:502: 00000100:00100000:0.0:1789061821.799271:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+8:6169:x1875967120245760:12345-192.168.203.3@tcp:502: Request processed in 161us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061821.799285:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 185 00000100:00100000:3.0:1789061821.818024:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061821.818139:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120245888 00000100:00100000:2.0:1789061821.818148:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120245888 00000100:00100000:2.0:1789061821.818204:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 186 00000100:00100000:2.0:1789061821.818228:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+8:6150:x1875967120245888:12345-192.168.203.3@tcp:101: 00010000:00010000:2.0:1789061821.818245:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061821.818263:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c74db400/0x2774d8f311dc673c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b70e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061821.818291:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c74db400/0x2774d8f311dc673c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b70e expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061821.818303:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c74db400/0x2774d8f311dc673c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b70e expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061821.818311:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c74db400, rc 0) 00000100:00100000:2.0:1789061821.818365:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+9:6150:x1875967120245888:12345-192.168.203.3@tcp:101: Request processed in 139us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061821.818372:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 186 00000100:00100000:3.0:1789061821.828541:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061821.828641:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120246016 00000100:00100000:1.0:1789061821.828651:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120246016 00000100:00100000:1.0:1789061821.828711:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 187 00000100:00100000:1.0:1789061821.828721:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+9:6150:x1875967120246016:12345-192.168.203.3@tcp:256: 20000000:01000000:1.0:1789061821.828743:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789061821.828772:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789061821.828784:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789061821.828787:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789061821.828790:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789061821.828792:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789061821.834864:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+9:6150:x1875967120246016:12345-192.168.203.3@tcp:256: Request processed in 6134us (6323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061821.834878:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 187 00000100:00100000:3.0:1789061821.838945:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061821.839083:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120246144 00000100:00100000:0.0:1789061821.839092:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120246144 00000100:00100000:0.0:1789061821.839153:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 188 00000100:00100000:0.0:1789061821.839163:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+9:6150:x1875967120246144:12345-192.168.203.3@tcp:101: 00010000:00010000:0.0:1789061821.839179:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061821.839196:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6743 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b715 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061821.839223:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6743 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b715 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061821.839233:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6743 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b715 expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061821.839249:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030400, rc 0) 00000100:00100000:0.0:1789061821.839299:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:6150:x1875967120246144:12345-192.168.203.3@tcp:101: Request processed in 138us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061821.839306:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 188 00000100:00100000:3.0:1789061821.848803:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061821.848943:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120246272 00000100:00100000:1.0:1789061821.848953:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120246272 00000100:00100000:1.0:1789061821.849007:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:1.0:1789061821.849017:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:6150:x1875967120246272:12345-192.168.203.3@tcp:501: 00000100:00100000:1.0:1789061821.849184:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:6150:x1875967120246272:12345-192.168.203.3@tcp:501: Request processed in 168us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061821.849192:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:3.0:1789061821.851546:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061821.851638:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120246400 00000100:00100000:2.0:1789061821.851646:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120246400 00000100:00100000:2.0:1789061821.851701:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:2.0:1789061821.851711:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+10:6150:x1875967120246400:12345-192.168.203.3@tcp:503: 00000100:00100000:2.0:1789061821.851848:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+10:6150:x1875967120246400:12345-192.168.203.3@tcp:503: Request processed in 137us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061821.851855:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:3.0:1789061821.856105:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061821.856205:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120246528 00000100:00100000:0.0:1789061821.856214:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120246528 00000100:00100000:0.0:1789061821.856271:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:0.0:1789061821.856280:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:6174:x1875967120246528:12345-192.168.203.3@tcp:502: 00000100:00100000:0.0:1789061821.856418:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:6174:x1875967120246528:12345-192.168.203.3@tcp:502: Request processed in 137us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061821.856425:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:3.0:1789061821.859247:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061821.859376:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120246656 00000100:00100000:1.0:1789061821.859385:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120246656 00000100:00100000:1.0:1789061821.859435:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:1.0:1789061821.859445:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:6174:x1875967120246656:12345-192.168.203.3@tcp:502: 00000100:00100000:1.0:1789061821.859588:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:6174:x1875967120246656:12345-192.168.203.3@tcp:502: Request processed in 143us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061821.859596:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:3.0:1789061821.874081:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061821.874208:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061821.874351:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120246784 00000100:00100000:0.0:1789061821.874372:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120246784 00000100:00100000:0.0:1789061821.874410:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120247040 00000100:00100000:0.0:1789061821.874413:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120247040 00000100:00100000:0.0:1789061821.874436:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1789061821.874443:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875967120246784:12345-192.168.203.3@tcp:38: 00010000:00080000:0.0:1789061821.874469:0:6497:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1789061821.874516:0:6497:0:(genops.c:1384:class_connect()) connect: client 8b387fcf-29cb-4ebc-866a-7eab61aa3868, cookie 0x2774d8f311dc674a 00000004:00100000:0.0:1789061821.874537:0:6497:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00100000:2.0:1789061821.874901:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:2.0:1789061821.874908:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2389:x1875967120247040:12345-192.168.203.3@tcp:38: 00010000:00080000:2.0:1789061821.874925:0:6496:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:2.0:1789061821.874952:0:6496:0:(genops.c:1384:class_connect()) connect: client 8b387fcf-29cb-4ebc-866a-7eab61aa3868, cookie 0x2774d8f311dc6751 00000004:00100000:2.0:1789061821.874969:0:6496:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1789061821.875134:0:6496:0:(import.c:65:import_set_state_nolock()) ffff9766c717c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061821.875198:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2389:x1875967120247040:12345-192.168.203.3@tcp:38: Request processed in 287us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061821.875205:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00080000:0.0:1789061821.875728:0:6497:0:(import.c:65:import_set_state_nolock()) ffff9766c572f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789061821.875757:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2389:x1875967120246784:12345-192.168.203.3@tcp:38: Request processed in 1313us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061821.875764:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00010000:00010000:0.0:1789061822.250063:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061822.630571:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061822.630694:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061822.630801:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120247168 00000100:00100000:2.0:1789061822.630808:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120246912 00000100:00100000:1.0:1789061822.630817:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120247168 00000100:00100000:2.0:1789061822.630820:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120246912 00000100:00100000:2.0:1789061822.630941:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:2.0:1789061822.630958:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:0:x1875967120246912:12345-192.168.203.3@tcp:41: 00000100:00100000:1.0:1789061822.630970:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:1.0:1789061822.630984:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:0:x1875967120247168:12345-192.168.203.3@tcp:41: 00000004:00000024:2.0:1789061822.631015:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000004:00000024:1.0:1789061822.631024:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789061822.631122:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:0:x1875967120246912:12345-192.168.203.3@tcp:41: Request processed in 169us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061822.631131:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:1.0:1789061822.631194:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:0:x1875967120247168:12345-192.168.203.3@tcp:41: Request processed in 209us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061822.631203:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00080000:3.0:1789061822.631886:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789061822.631893:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061822.633898:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061822.633930:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130779904:0@lo:41: 00000100:00100000:2.0:1789061822.634015:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061822.634374:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130779904 00000100:00100000:3.0:1789061822.634400:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130779904 00000100:00100000:3.0:1789061822.634461:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789061822.634472:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130779904:12345-0@lo:41: 00000004:00000024:3.0:1789061822.634502:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789061822.634564:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130779904:12345-0@lo:41: Request processed in 94us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061822.634571:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789061822.635716:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130779904:0@lo:41: 00000100:00100000:3.0:1789061822.635958:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061822.636037:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120247296 00000100:00100000:2.0:1789061822.636052:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120247296 00000100:00100000:2.0:1789061822.636107:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:2.0:1789061822.636115:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6150:x1875967120247296:12345-192.168.203.3@tcp:41: 00000004:00000024:2.0:1789061822.636285:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789061822.636375:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6150:x1875967120247296:12345-192.168.203.3@tcp:41: Request processed in 260us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061822.636383:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1789061822.638443:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061822.638655:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120247424 00000100:00100000:1.0:1789061822.638682:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120247424 00000100:00100000:1.0:1789061822.638808:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:1.0:1789061822.638817:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6150:x1875967120247424:12345-192.168.203.3@tcp:40: 00000100:00100000:1.0:1789061822.638916:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6150:x1875967120247424:12345-192.168.203.3@tcp:40: Request processed in 100us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061822.638923:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1789061822.643424:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061822.643466:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061822.643504:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061822.643511:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120247552 00000100:00100000:1.0:1789061822.643525:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120247552 00000100:00100000:3.0:1789061822.643551:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061822.643565:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120247680 00000100:00100000:1.0:1789061822.643570:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120247680 00000100:00100000:1.0:1789061822.643627:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1789061822.643639:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875967120247552:12345-192.168.203.3@tcp:8: 00000100:00100000:3.0:1789061822.643656:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120247936 00000100:00100000:3.0:1789061822.643667:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120247936 00000100:00100000:3.0:1789061822.643728:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1789061822.643738:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6150:x1875967120247936:12345-192.168.203.3@tcp:900: 00000100:00100000:3.0:1789061822.643828:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6150:x1875967120247936:12345-192.168.203.3@tcp:900: Request processed in 91us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061822.643836:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1789061822.643866:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1789061822.643872:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875967120247680:12345-192.168.203.3@tcp:8: 00010000:00080000:3.0:1789061822.643897:0:8412:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:3.0:1789061822.643934:0:8412:0:(genops.c:1384:class_connect()) connect: client 8b387fcf-29cb-4ebc-866a-7eab61aa3868, cookie 0x2774d8f311dc6758 00002000:00100000:3.0:1789061822.643948:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8b387fcf-29cb-4ebc-866a-7eab61aa3868/ffff9767fd822000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789061822.643971:0:8412:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00000100:00100000:2.0:1789061822.644619:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120247808 00000100:00100000:2.0:1789061822.644626:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120247808 00000100:00100000:2.0:1789061822.644688:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:2.0:1789061822.644707:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+10:2393:x1875967120247808:12345-192.168.203.3@tcp:400: 00000100:00100000:2.0:1789061822.644759:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+10:2393:x1875967120247808:12345-192.168.203.3@tcp:400: Request processed in 55us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061822.644766:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 193 00010000:00080000:1.0:1789061822.645415:0:8413:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:1.0:1789061822.645459:0:8413:0:(genops.c:1384:class_connect()) connect: client 8b387fcf-29cb-4ebc-866a-7eab61aa3868, cookie 0x2774d8f311dc675f 00002000:00100000:1.0:1789061822.645573:0:8413:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8b387fcf-29cb-4ebc-866a-7eab61aa3868/ffff9766c754b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789061822.645594:0:8413:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789061822.646150:0:8413:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789061822.646185:0:8413:0:(import.c:65:import_set_state_nolock()) ffff9766c754c000 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1789061822.646865:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789061822.646908:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9767fd824000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061822.647001:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2389:x1875967120247552:12345-192.168.203.3@tcp:8: Request processed in 3361us (3589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061822.647014:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1789061822.647201:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2389:x1875967120247680:12345-192.168.203.3@tcp:8: Request processed in 3323us (3731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061822.647213:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1789061822.649988:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061822.650448:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120248064 00000100:00100000:1.0:1789061822.650477:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120248064 00000100:00100000:1.0:1789061822.650548:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:1.0:1789061822.650653:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6150:x1875967120248064:12345-192.168.203.3@tcp:33: 00000004:00080000:1.0:1789061822.730866:0:6499:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 80088us 00000004:00200000:2.0:1789061822.759268:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789061822.759373:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6150:x1875967120248064:12345-192.168.203.3@tcp:33: Request processed in 108809us (109392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061822.759389:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1789061823.008827:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061823.008928:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120248192 00000100:00100000:2.0:1789061823.008938:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120248192 00000100:00100000:2.0:1789061823.008995:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:2.0:1789061823.009005:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6193:x1875967120248192:12345-192.168.203.3@tcp:101: 00010000:00010000:2.0:1789061823.009033:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061823.009097:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c74db000/0x2774d8f311dc6766 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b746 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061823.009159:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c74dbc00/0x2774d8f311dc676d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061823.009172:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c74dbc00/0x2774d8f311dc676d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061823.009186:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c74dbc00/0x2774d8f311dc676d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061823.009231:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789061823.009235:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061823.009265:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c74dbc00/0x2774d8f311dc676d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061823.009289:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c74db000/0x2774d8f311dc6766 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b746 expref: 8 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061823.009306:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c74dbc00/0x2774d8f311dc676d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b746 expref: 7 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061823.009315:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d12d4900) 00010000:00010000:2.0:1789061823.009318:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061823.009322:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c74dbc00, rc 0) 00000100:00100000:2.0:1789061823.009381:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:6193:x1875967120248192:12345-192.168.203.3@tcp:101: Request processed in 377us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061823.009388:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:2.0:1789061823.145903:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130780032:0@lo:13: 00000100:00100000:2.0:1789061823.145970:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061823.146214:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130780032 00000100:00100000:0.0:1789061823.146221:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061823.146222:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130780032 00000100:00100000:0.0:1789061823.146234:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130780160:0@lo:13: 00000100:00100000:0.0:1789061823.146271:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061823.146278:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130780160 00000100:00100000:1.0:1789061823.146282:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130780160 00000100:00100000:1.0:1789061823.146303:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789061823.146310:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061823.146312:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130780032:12345-0@lo:13: 00002000:00000024:1.0:1789061823.146333:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061823.146385:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130780032:12345-0@lo:13: Request processed in 74us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061823.146392:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789061823.146406:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789061823.146412:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130780160:12345-0@lo:13: 00002000:00000024:1.0:1789061823.146421:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061823.146445:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130780160:12345-0@lo:13: Request processed in 33us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061823.146450:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789061823.146527:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7511f80 x1875967130780160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061823.146546:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130780160:0@lo:13: 00010000:00080000:0.0:1789061823.146573:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd346680 x1875967130780032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061823.146583:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130780032:0@lo:13: 00010000:00010000:2.0:1789061823.273965:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061824.298019:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061824.682001:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130780288:0@lo:400: 00000100:00100000:0.0:1789061824.682083:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061824.682149:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130780800:0@lo:400: 00000100:00100000:0.0:1789061824.682177:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061824.682200:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130781312:0@lo:400: 00000100:00100000:0.0:1789061824.682221:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061824.682239:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130781824:0@lo:400: 00000100:00100000:0.0:1789061824.682257:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061824.682281:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789061824.682286:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130780672:0@lo:400: 00000100:00100000:0.0:1789061824.682310:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061824.682326:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130781184:0@lo:400: 00000100:00100000:0.0:1789061824.682346:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061824.682360:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130781696:0@lo:400: 00000100:00100000:0.0:1789061824.682377:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061824.682405:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130780800 00000100:00100000:0.0:1789061824.682412:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130780800 00000100:00100000:0.0:1789061824.682456:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789061824.682465:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130780800:12345-0@lo:400: 00000100:00100000:0.0:1789061824.682520:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130780800:12345-0@lo:400: Request processed in 56us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061824.682528:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789061824.682559:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130781312 00000100:00100000:0.0:1789061824.682563:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130781312 00000100:00100000:0.0:1789061824.682582:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130781824 00000100:00100000:0.0:1789061824.682584:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130781824 00000100:00100000:0.0:1789061824.682629:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130781184 00000100:00100000:0.0:1789061824.682633:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130781184 00000100:00100000:0.0:1789061824.682665:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130781696 00000100:00100000:0.0:1789061824.682668:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130781696 00000100:00100000:0.0:1789061824.682684:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789061824.682689:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130781312:12345-0@lo:400: 00000100:00100000:0.0:1789061824.682720:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130781312:12345-0@lo:400: Request processed in 30us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061824.682727:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789061824.682737:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789061824.682743:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130781824:12345-0@lo:400: 00000100:00100000:0.0:1789061824.682765:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130781824:12345-0@lo:400: Request processed in 22us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061824.682772:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789061824.682784:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789061824.682790:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130781184:12345-0@lo:400: 00000100:00100000:2.0:1789061824.682815:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130780672 00000100:00100000:0.0:1789061824.682817:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130781184:12345-0@lo:400: Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061824.682821:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130780672 00000100:00100000:0.0:1789061824.682826:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789061824.682842:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789061824.682849:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130781696:12345-0@lo:400: 00000100:00100000:2.0:1789061824.682866:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789061824.682875:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130781696:12345-0@lo:400: Request processed in 26us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061824.682877:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130780672:12345-0@lo:400: 00000100:00100000:0.0:1789061824.682889:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789061824.682907:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061824.682924:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130780672:12345-0@lo:400: Request processed in 50us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061824.682931:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789061824.682941:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130780672:0@lo:400: 00010000:00080000:0.0:1789061824.682955:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676f480 x1875967130781184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061824.682960:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130780544:0@lo:400: 00000100:00100000:0.0:1789061824.682986:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130781184:0@lo:400: 00000100:00100000:2.0:1789061824.682991:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789061824.683004:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676dc00 x1875967130781696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061824.683013:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130781696:0@lo:400: 00000100:00100000:0.0:1789061824.683027:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130780800:0@lo:400: 00000100:00100000:2.0:1789061824.683034:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130781056:0@lo:400: 00010000:00080000:0.0:1789061824.683036:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676f100 x1875967130781312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061824.683048:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130781312:0@lo:400: 00010000:00080000:0.0:1789061824.683062:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676d500 x1875967130781824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061824.683063:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061824.683075:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130781824:0@lo:400: 00000100:00100000:2.0:1789061824.683091:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130781568:0@lo:400: 00000100:00100000:2.0:1789061824.683111:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061824.683123:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130780544 00000100:00100000:0.0:1789061824.683127:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130780544 00000100:00100000:2.0:1789061824.683130:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789061824.683137:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130780416:0@lo:400: 00000100:00100000:0.0:1789061824.683156:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789061824.683159:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061824.683167:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130780544:12345-0@lo:400: 00000100:00100000:2.0:1789061824.683176:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130780928:0@lo:400: 00000100:00100000:2.0:1789061824.683207:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061824.683214:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130780544:12345-0@lo:400: Request processed in 47us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061824.683221:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789061824.683222:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130781440:0@lo:400: 00000100:00100000:2.0:1789061824.683243:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061824.683253:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130781056 00000100:00100000:0.0:1789061824.683258:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130781056 00000100:00100000:2.0:1789061824.683261:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130780544:0@lo:400: 00000100:00100000:2.0:1789061824.683284:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130781568 00000100:00100000:2.0:1789061824.683287:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130781568 00000100:00100000:0.0:1789061824.683289:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130780416 00000100:00100000:0.0:1789061824.683294:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130780416 00000100:00100000:2.0:1789061824.683310:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130780928 00000100:00100000:2.0:1789061824.683314:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130780928 00000100:00100000:0.0:1789061824.683315:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130781440 00000100:00100000:0.0:1789061824.683320:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130781440 00000100:00100000:2.0:1789061824.683333:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789061824.683341:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130781056:12345-0@lo:400: 00000100:00100000:0.0:1789061824.683357:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789061824.683366:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130781568:12345-0@lo:400: 00000100:00100000:2.0:1789061824.683373:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130781056:12345-0@lo:400: Request processed in 33us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061824.683380:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789061824.683394:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789061824.683402:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130780416:12345-0@lo:400: 00000100:00100000:0.0:1789061824.683408:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130781568:12345-0@lo:400: Request processed in 43us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061824.683416:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789061824.683432:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130780416:12345-0@lo:400: Request processed in 30us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061824.683438:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789061824.683447:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130780928:12345-0@lo:400: 00000100:00100000:0.0:1789061824.683480:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130780928:12345-0@lo:400: Request processed in 34us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061824.683493:0:6498:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789061824.683501:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789061824.683538:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130780288 00000100:00100000:3.0:1789061824.683544:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130780288 00000100:00100000:3.0:1789061824.683580:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789061824.683589:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130780288:12345-0@lo:400: 00000100:00100000:2.0:1789061824.683637:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789061824.683649:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130780288:12345-0@lo:400: Request processed in 60us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061824.683667:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789061824.683671:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789061824.683680:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130781440:12345-0@lo:400: 00000100:00100000:2.0:1789061824.683712:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130781440:12345-0@lo:400: Request processed in 35us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061824.683719:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789061824.683728:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130780288:0@lo:400: 00000100:00100000:2.0:1789061824.683750:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130780416:0@lo:400: 00000100:00080000:3.0:1789061824.683758:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061824.683762:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130780928:0@lo:400: 00000100:00080000:3.0:1789061824.683763:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789061824.683775:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130781440:0@lo:400: 00010000:00080000:2.0:1789061824.683786:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676c380 x1875967130781056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061824.683795:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130781056:0@lo:400: 00010000:00080000:2.0:1789061824.683803:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676e680 x1875967130781568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061824.683810:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130781568:0@lo:400: 00000100:00100000:0.0:1789061824.686109:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789061825.193766:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130781952:0@lo:13: 00000100:00100000:1.0:1789061825.193832:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061825.193833:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130782208:0@lo:41: 00000100:00100000:2.0:1789061825.193871:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061825.193904:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061825.193915:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130782080:0@lo:13: 00000100:00100000:2.0:1789061825.193919:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130782208 00000100:00100000:2.0:1789061825.193928:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130782208 00000100:00100000:1.0:1789061825.193944:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061825.193967:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130781952 00000100:00100000:0.0:1789061825.193973:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130781952 00000100:00100000:2.0:1789061825.193977:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789061825.193985:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130782208:12345-0@lo:41: 00000100:00100000:1.0:1789061825.193989:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130782080 00000100:00100000:1.0:1789061825.193994:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130782080 00000100:00100000:0.0:1789061825.193999:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789061825.194008:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130781952:12345-0@lo:13: 00000004:00000024:2.0:1789061825.194018:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00002000:00000024:0.0:1789061825.194026:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061825.194068:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130782208:12345-0@lo:41: Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061825.194068:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130781952:12345-0@lo:13: Request processed in 60us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061825.194076:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789061825.194076:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789061825.194091:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130782208:0@lo:41: 00000100:00100000:0.0:1789061825.194097:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789061825.194106:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130782080:12345-0@lo:13: 00002000:00000024:0.0:1789061825.194117:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1789061825.194131:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd347b80 x1875967130781952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061825.194145:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130782080:12345-0@lo:13: Request processed in 38us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061825.194148:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130781952:0@lo:13: 00000100:00100000:0.0:1789061825.194155:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789061825.194174:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676e680 x1875967130782080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061825.194186:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130782080:0@lo:13: 00010000:00010000:0.0:1789061825.321981:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061825.671925:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061825.672032:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120248320 00000100:00100000:0.0:1789061825.672046:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120248320 00000100:00100000:0.0:1789061825.672185:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1789061825.672198:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:6245:x1875967120248320:12345-192.168.203.3@tcp:41: 00000004:00000024:0.0:1789061825.672252:0:8435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789061825.672338:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:6245:x1875967120248320:12345-192.168.203.3@tcp:41: Request processed in 142us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061825.672347:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00080000:1.0:1789061825.672706:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061825.680796:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061825.680925:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120248448 00000100:00100000:2.0:1789061825.680940:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120248448 00000100:00100000:2.0:1789061825.681044:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1789061825.681060:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6245:x1875967120248448:12345-192.168.203.3@tcp:41: 00000004:00000024:2.0:1789061825.681090:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789061825.681161:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6245:x1875967120248448:12345-192.168.203.3@tcp:41: Request processed in 108us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061825.681169:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00080000:3.0:1789061825.682156:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789061825.684586:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061825.684688:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120248576 00000100:00100000:1.0:1789061825.684705:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120248576 00000100:00100000:1.0:1789061825.684816:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1789061825.684830:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6245:x1875967120248576:12345-192.168.203.3@tcp:13: 00002000:00000024:1.0:1789061825.684877:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061825.684979:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6245:x1875967120248576:12345-192.168.203.3@tcp:13: Request processed in 151us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061825.684987:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00080000:3.0:1789061825.685078:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061825.687375:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061825.687462:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120248704 00000100:00100000:0.0:1789061825.687477:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120248704 00000100:00100000:0.0:1789061825.687743:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:0.0:1789061825.687754:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6245:x1875967120248704:12345-192.168.203.3@tcp:13: 00002000:00000024:0.0:1789061825.687779:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061825.687850:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:6245:x1875967120248704:12345-192.168.203.3@tcp:13: Request processed in 97us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061825.687857:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00080000:3.0:1789061825.688887:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789061826.357084:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789061826.734848:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00010000:00010000:2.0:1789061827.370235:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061827.754459:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061827.757741:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130782336:0@lo:41: 00000100:00100000:0.0:1789061827.757808:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061827.757932:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130782336 00000100:00100000:3.0:1789061827.757941:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130782336 00000100:00100000:3.0:1789061827.757983:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789061827.757992:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130782336:12345-0@lo:41: 00000004:00000024:3.0:1789061827.758022:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789061827.758095:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130782336:12345-0@lo:41: Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061827.758102:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789061827.758247:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130782336:0@lo:41: 00000001:00100000:3.0:1789061827.761054:0:7427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000001:00100000:2.0:1789061827.766266:0:6474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000100:00100000:0.0:1789061827.853303:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061827.853350:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061827.853386:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061827.853416:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061827.853445:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061827.853473:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120249088 00000100:00100000:0.0:1789061827.853483:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120249088 00000100:00100000:0.0:1789061827.853548:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120248960 00000100:00100000:0.0:1789061827.853552:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120248960 00000100:00100000:0.0:1789061827.853574:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:0.0:1789061827.853584:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120249088:12345-192.168.203.3@tcp:400: 00000100:00100000:0.0:1789061827.853690:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120249088:12345-192.168.203.3@tcp:400: Request processed in 107us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061827.853697:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:0.0:1789061827.853714:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1789061827.853721:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120248960:12345-192.168.203.3@tcp:400: 00000100:00100000:0.0:1789061827.853745:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120248960:12345-192.168.203.3@tcp:400: Request processed in 25us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061827.853751:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1789061827.853768:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120249344 00000100:00100000:0.0:1789061827.853772:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120249344 00000100:00100000:0.0:1789061827.853793:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120249216 00000100:00100000:0.0:1789061827.853796:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120249216 00000100:00100000:0.0:1789061827.853818:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1789061827.853825:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120249344:12345-192.168.203.3@tcp:400: 00000100:00100000:0.0:1789061827.853849:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120249344:12345-192.168.203.3@tcp:400: Request processed in 25us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061827.853855:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1789061827.853865:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1789061827.853871:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120249216:12345-192.168.203.3@tcp:400: 00000100:00100000:0.0:1789061827.853891:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120249216:12345-192.168.203.3@tcp:400: Request processed in 21us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061827.853897:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00080000:0.0:1789061827.853918:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789061827.853922:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061827.853924:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061827.853926:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061827.859079:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120248832 00000100:00100000:1.0:1789061827.859094:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120248832 00000100:00100000:1.0:1789061827.859236:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 195 00000100:00100000:1.0:1789061827.859247:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:2392:x1875967120248832:12345-192.168.203.3@tcp:400: 00000100:00100000:1.0:1789061827.859325:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:2392:x1875967120248832:12345-192.168.203.3@tcp:400: Request processed in 77us (6028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061827.859333:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 195 00000100:00100000:0.0:1789061828.265940:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061828.265978:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130782464:0@lo:13: 00000100:00100000:0.0:1789061828.266073:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061828.266312:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130782464 00000100:00100000:3.0:1789061828.266323:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130782464 00000100:00100000:3.0:1789061828.266401:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789061828.266414:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130782464:12345-0@lo:13: 00002000:00000024:3.0:1789061828.266449:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061828.266512:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130782464:12345-0@lo:13: Request processed in 102us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061828.266519:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1789061828.266573:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd51f480 x1875967130782464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061828.266594:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130782464:0@lo:13: 00000100:00100000:2.0:1789061828.268579:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061828.268647:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130782592:0@lo:13: 00000100:00080000:0.0:1789061828.268705:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061828.268727:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061828.268802:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130782592 00000100:00100000:1.0:1789061828.268812:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130782592 00000100:00100000:1.0:1789061828.268875:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789061828.268884:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130782592:12345-0@lo:13: 00002000:00000024:1.0:1789061828.268906:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061828.268950:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130782592:12345-0@lo:13: Request processed in 67us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061828.268957:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789061828.269036:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd347b80 x1875967130782592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061828.269056:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130782592:0@lo:13: 00000100:00080000:0.0:1789061828.271572:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789061828.393846:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789061828.779702:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000001:02000400:2.0:1789061829.005833:0:10163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789061829.419927:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061829.803426:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130782848:0@lo:400: 00000100:00100000:3.0:1789061829.803493:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061829.803547:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130783360:0@lo:400: 00000100:00100000:3.0:1789061829.803569:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061829.803591:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130783872:0@lo:400: 00000100:00100000:3.0:1789061829.803640:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061829.804808:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789061829.804821:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130782720:0@lo:400: 00000100:00100000:3.0:1789061829.804868:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061829.804974:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130783232:0@lo:400: 00000100:00100000:3.0:1789061829.805003:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061829.805025:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130783744:0@lo:400: 00000100:00100000:3.0:1789061829.805047:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061829.805081:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130784256:0@lo:400: 00000100:00100000:0.0:1789061829.805086:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130782848 00000100:00100000:0.0:1789061829.805094:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130782848 00000100:00100000:0.0:1789061829.805133:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130783360 00000100:00100000:0.0:1789061829.805136:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130783360 00000100:00100000:0.0:1789061829.805160:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130783872 00000100:00100000:0.0:1789061829.805163:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130783872 00000100:00100000:3.0:1789061829.805178:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061829.805187:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789061829.805193:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875967130783104:0@lo:400: 00000100:00100000:0.0:1789061829.805196:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130782848:12345-0@lo:400: 00000100:00100000:3.0:1789061829.805218:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130782720 00000100:00100000:3.0:1789061829.805223:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130782720 00000100:00100000:2.0:1789061829.805228:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061829.805245:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130783616:0@lo:400: 00000100:00100000:0.0:1789061829.805250:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130782848:12345-0@lo:400: Request processed in 56us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061829.805261:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789061829.805266:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789061829.805267:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061829.805284:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130782720:12345-0@lo:400: 00000100:00100000:0.0:1789061829.805284:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130783104 00000100:00100000:2.0:1789061829.805286:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130784128:0@lo:400: 00000100:00100000:0.0:1789061829.805286:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130783104 00000100:00100000:0.0:1789061829.805303:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789061829.805311:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061829.805311:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130783360:12345-0@lo:400: 00000100:00100000:3.0:1789061829.805335:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130782720:12345-0@lo:400: Request processed in 64us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061829.805342:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789061829.805345:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789061829.805347:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130783360:12345-0@lo:400: Request processed in 38us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061829.805351:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130782976:0@lo:400: 00000100:00100000:0.0:1789061829.805355:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789061829.805370:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789061829.805374:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061829.805385:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130783872:12345-0@lo:400: 00000100:00100000:2.0:1789061829.805390:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130783488:0@lo:400: 00000100:00100000:2.0:1789061829.805408:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061829.805409:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130783872:12345-0@lo:400: Request processed in 27us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061829.805415:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789061829.805416:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130784000:0@lo:400: 00000100:00100000:0.0:1789061829.805425:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130783488 00000100:00100000:0.0:1789061829.805428:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130783488 00000100:00100000:2.0:1789061829.805433:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061829.805450:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130783232 00000100:00100000:3.0:1789061829.805456:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130783232 00000100:00100000:2.0:1789061829.805476:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130783744 00000100:00100000:2.0:1789061829.805482:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130783744 00000100:00100000:3.0:1789061829.805486:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130782976 00000100:00100000:3.0:1789061829.805490:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130782976 00000100:00100000:2.0:1789061829.805509:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130784256 00000100:00100000:3.0:1789061829.805514:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789061829.805515:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130784256 00000100:00100000:0.0:1789061829.805515:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130784000 00000100:00100000:0.0:1789061829.805519:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130784000 00000100:00100000:2.0:1789061829.805532:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130783616 00000100:00100000:2.0:1789061829.805535:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130783616 00000100:00100000:0.0:1789061829.805535:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789061829.805540:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875967130783104:12345-0@lo:400: 00000100:00100000:2.0:1789061829.805544:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130784128 00000100:00100000:2.0:1789061829.805546:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130784128 00000100:00100000:2.0:1789061829.805557:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789061829.805562:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130783744:12345-0@lo:400: 00000100:00100000:0.0:1789061829.805572:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875967130783104:12345-0@lo:400: Request processed in 32us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061829.805578:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789061829.805588:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130783744:12345-0@lo:400: Request processed in 25us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061829.805589:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789061829.805594:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789061829.805594:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130783488:12345-0@lo:400: 00000100:00100000:2.0:1789061829.805631:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789061829.805639:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130784256:12345-0@lo:400: 00000100:00100000:3.0:1789061829.805641:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130783232:12345-0@lo:400: 00000100:00100000:0.0:1789061829.805661:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130783488:12345-0@lo:400: Request processed in 66us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061829.805665:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130784256:12345-0@lo:400: Request processed in 28us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061829.805667:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789061829.805670:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789061829.805683:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789061829.805683:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789061829.805690:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130783616:12345-0@lo:400: 00000100:00100000:0.0:1789061829.805691:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130784000:12345-0@lo:400: 00000100:00100000:3.0:1789061829.805702:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130783232:12345-0@lo:400: Request processed in 177us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061829.805710:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789061829.805724:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130783616:12345-0@lo:400: Request processed in 34us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061829.805724:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130784000:12345-0@lo:400: Request processed in 32us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061829.805732:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789061829.805732:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789061829.805738:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789061829.805748:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130782976:12345-0@lo:400: 00000100:00100000:2.0:1789061829.805754:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789061829.805762:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130784128:12345-0@lo:400: 00000100:00080000:0.0:1789061829.805768:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061829.805772:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789061829.805774:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061829.805789:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130782976:12345-0@lo:400: Request processed in 44us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061829.805797:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789061829.806072:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130782976:0@lo:400: 00000100:00100000:2.0:1789061829.812034:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130784128:12345-0@lo:400: Request processed in 6163us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061829.812047:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789061829.813823:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130782720:0@lo:400: 00010000:00080000:0.0:1789061829.814126:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676e300 x1875967130783488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061829.814138:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130783488:0@lo:400: 00010000:00080000:0.0:1789061829.814154:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fb0af480 x1875967130784000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061829.814162:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130784000:0@lo:400: 00000100:00100000:0.0:1789061829.814175:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875967130783104:0@lo:400: 00010000:00080000:0.0:1789061829.814186:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676e680 x1875967130783616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061829.814195:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130783616:0@lo:400: 00010000:00080000:0.0:1789061829.814209:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fb0af800 x1875967130784128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061829.814212:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130783232:0@lo:400: 00000100:00100000:0.0:1789061829.814218:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130784128:0@lo:400: 00010000:00080000:3.0:1789061829.814235:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676b800 x1875967130783744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061829.814257:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130783744:0@lo:400: 00010000:00080000:3.0:1789061829.814272:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fb0ac000 x1875967130784256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061829.814281:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130784256:0@lo:400: 00000100:00100000:3.0:1789061829.814294:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130782848:0@lo:400: 00000100:00100000:3.0:1789061829.814307:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130783360:0@lo:400: 00000100:00100000:3.0:1789061829.814318:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130783872:0@lo:400: 00000100:00100000:1.0:1789061830.316085:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130784384:0@lo:13: 00000100:00100000:1.0:1789061830.316153:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061830.316221:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130784512:0@lo:41: 00000100:00100000:1.0:1789061830.316245:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061830.316277:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130784384 00000100:00100000:1.0:1789061830.316283:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130784384 00000100:00100000:1.0:1789061830.316327:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789061830.316334:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130784384:12345-0@lo:13: 00002000:00000024:1.0:1789061830.316360:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061830.316404:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130784384:12345-0@lo:13: Request processed in 69us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061830.316410:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789061830.316431:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130784512 00000100:00100000:1.0:1789061830.316434:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130784512 00000100:00100000:1.0:1789061830.316457:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789061830.316463:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130784512:12345-0@lo:41: 00000004:00000024:1.0:1789061830.316482:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789061830.316516:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130784512:12345-0@lo:41: Request processed in 52us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061830.316538:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789061830.316582:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130784512:0@lo:41: 00010000:00080000:1.0:1789061830.316634:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd344700 x1875967130784384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061830.316647:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130784384:0@lo:13: 00000100:00100000:1.0:1789061830.316976:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130784640:0@lo:13: 00000100:00100000:1.0:1789061830.317004:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061830.317030:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130784640 00000100:00100000:1.0:1789061830.317034:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130784640 00000100:00100000:1.0:1789061830.317054:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789061830.317060:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130784640:12345-0@lo:13: 00002000:00000024:1.0:1789061830.317071:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061830.317099:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130784640:12345-0@lo:13: Request processed in 38us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061830.317104:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789061830.317129:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fb0adc00 x1875967130784640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061830.317141:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130784640:0@lo:13: 00010000:00010000:3.0:1789061830.442202:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061831.473944:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061832.502894:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061832.874431:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061832.874452:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130784768:0@lo:41: 00000100:00100000:3.0:1789061832.874523:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061832.874578:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130784768 00000100:00100000:3.0:1789061832.874584:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130784768 00000100:00100000:3.0:1789061832.874649:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789061832.874657:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130784768:12345-0@lo:41: 00000004:00000024:3.0:1789061832.874687:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789061832.874740:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130784768:12345-0@lo:41: Request processed in 83us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061832.874746:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789061832.874856:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130784768:0@lo:41: 00000100:00100000:1.0:1789061832.967510:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061832.967551:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061832.967579:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061832.967621:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061832.967647:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061832.967674:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120249856 00000100:00100000:1.0:1789061832.967684:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120249856 00000100:00100000:1.0:1789061832.967749:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120249984 00000100:00100000:1.0:1789061832.967753:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120249984 00000100:00100000:1.0:1789061832.967778:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1789061832.967787:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120249856:12345-192.168.203.3@tcp:400: 00000100:00100000:1.0:1789061832.967852:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120249856:12345-192.168.203.3@tcp:400: Request processed in 66us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061832.967859:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1789061832.967875:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1789061832.967881:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120249984:12345-192.168.203.3@tcp:400: 00000100:00100000:1.0:1789061832.967905:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120249984:12345-192.168.203.3@tcp:400: Request processed in 24us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061832.967910:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1789061832.967927:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120249472 00000100:00100000:1.0:1789061832.967931:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120249472 00000100:00100000:1.0:1789061832.967952:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 197 00000100:00100000:1.0:1789061832.967958:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:2390:x1875967120249472:12345-192.168.203.3@tcp:400: 00000100:00100000:1.0:1789061832.967994:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:2390:x1875967120249472:12345-192.168.203.3@tcp:400: Request processed in 35us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061832.967999:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 197 00000100:00100000:1.0:1789061832.968024:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120249600 00000100:00100000:1.0:1789061832.968027:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120249600 00000100:00100000:1.0:1789061832.968050:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120249728 00000100:00100000:1.0:1789061832.968052:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120249728 00000100:00100000:1.0:1789061832.968070:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1789061832.968075:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2390:x1875967120249600:12345-192.168.203.3@tcp:400: 00000100:00100000:1.0:1789061832.968100:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2390:x1875967120249600:12345-192.168.203.3@tcp:400: Request processed in 25us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061832.968110:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1789061832.968122:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:1.0:1789061832.968139:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120249728:12345-192.168.203.3@tcp:400: 00000100:00100000:1.0:1789061832.968163:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120249728:12345-192.168.203.3@tcp:400: Request processed in 24us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061832.968169:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00080000:1.0:1789061832.968185:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789061832.968188:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061832.968191:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061832.968193:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789061833.067397:0:10311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7814d4a0 20000000:00000080:3.0:1789061833.067413:0:10311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9767fd352000 uarg=0000000000000000 20000000:01000000:3.0:1789061833.067463:0:10311:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789061833.067470:0:10311:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789061833.067473:0:10311:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789061833.067477:0:10311:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789061833.067481:0:10311:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789061833.067550:0:10311:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789061833.067553:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789061833.072695:0:10312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1789061833.072985:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1789061833.073016:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1789061833.073031:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1789061833.073044:0:10311:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789061833.073046:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789061833.073402:0:10313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1789061833.073559:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1789061833.073580:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1789061833.073594:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1789061833.073642:0:10311:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789061833.073644:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789061833.074681:0:10314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1789061833.074939:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1789061833.074963:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1789061833.074978:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1789061833.074991:0:10311:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789061833.074993:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789061833.075285:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1789061833.075521:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1789061833.075551:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1789061833.075566:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1789061833.075575:0:10311:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789061833.075576:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789061833.076256:0:10316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1789061833.076988:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1789061833.077016:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1789061833.077032:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:0.0:1789061833.077047:0:10311:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789061833.077066:0:10311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077083:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc660f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6608 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077091:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c1483200/0x2774d8f311dc6639 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6632 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077097:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6671 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077104:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc667f expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077110:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc668d expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077116:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c3798600/0x2774d8f311dc66b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc66a9 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077122:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c1482600/0x2774d8f311dc66d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc66cc expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077139:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc66f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc66ef expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077146:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6719 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077155:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c74dba00/0x2774d8f311dc672e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6d6 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077163:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc6735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6dd expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077169:0:10311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077206:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc6735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6dd expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077221:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc6735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6dd expref: 9 pid: 6490 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.077235:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130784896:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061833.077334:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c74dba00/0x2774d8f311dc672e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6d6 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077343:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766c74dba00/0x2774d8f311dc672e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6d6 expref: 9 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.077351:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785024:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061833.077388:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6719 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077396:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6719 expref: 23 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.077405:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785152:0@lo:104: 00000100:00100000:0.0:1789061833.077441:0:10311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061833.077474:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc66f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc66ef expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.077482:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc66f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc66ef expref: 23 pid: 6488 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.077490:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785280:0@lo:104: 00000100:00100000:0.0:1789061833.077522:0:10311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061833.078696:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c1482600/0x2774d8f311dc66d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc66cc expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.078709:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c1482600/0x2774d8f311dc66d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc66cc expref: 23 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.078719:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785408:0@lo:104: 00000100:00100000:0.0:1789061833.078754:0:10311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061833.081043:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c3798600/0x2774d8f311dc66b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc66a9 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.081058:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c3798600/0x2774d8f311dc66b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc66a9 expref: 23 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.081089:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785536:0@lo:104: 00000100:00100000:0.0:1789061833.081139:0:10311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061833.081186:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130785152 00000100:00100000:2.0:1789061833.081194:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130785152 00000100:00100000:2.0:1789061833.081231:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130785280 00000100:00100000:2.0:1789061833.081234:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130785280 00000100:00100000:2.0:1789061833.081244:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130785408 00000100:00100000:2.0:1789061833.081247:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130785408 00000100:00100000:2.0:1789061833.081258:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789061833.081265:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:10311:x1875967130785152:12345-0@lo:104: 00010000:00010000:2.0:1789061833.081280:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6720 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.081329:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789061833.081334:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:10311:x1875967130785152:12345-0@lo:104: Request processed in 69us (3893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.081341:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789061833.081356:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789061833.081361:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:10311:x1875967130785280:12345-0@lo:104: 00010000:00010000:2.0:1789061833.081368:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc66f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.081407:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789061833.081412:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:10311:x1875967130785280:12345-0@lo:104: Request processed in 51us (3890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.081418:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789061833.081431:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789061833.081436:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:10311:x1875967130785408:12345-0@lo:104: 00010000:00010000:2.0:1789061833.081443:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc66d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.081470:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789061833.081475:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:10311:x1875967130785408:12345-0@lo:104: Request processed in 40us (2721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.081481:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789061833.081787:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc668d expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.081797:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc668d expref: 23 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.081805:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785664:0@lo:104: 00010000:00010000:0.0:1789061833.081833:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc667f expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.081841:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc667f expref: 23 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.081848:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785792:0@lo:104: 00010000:00010000:0.0:1789061833.081869:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6671 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.081876:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6671 expref: 23 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.081882:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785920:0@lo:104: 00010000:00010000:0.0:1789061833.081902:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c1483200/0x2774d8f311dc6639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6632 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.081909:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c1483200/0x2774d8f311dc6639 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6632 expref: 23 pid: 6488 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.081928:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130786048:0@lo:104: 00010000:00010000:0.0:1789061833.081952:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc660f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6608 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.081960:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc660f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6608 expref: 23 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.081968:0:10311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130786176:0@lo:104: 00000100:00100000:0.0:1789061833.081985:0:10311:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5a5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061833.082004:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785152:0@lo:104: 00000100:00100000:0.0:1789061833.082012:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785280:0@lo:104: 00000100:00100000:0.0:1789061833.082019:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785408:0@lo:104: 00000100:00100000:3.0:1789061833.082138:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130785536 00000100:00100000:3.0:1789061833.082144:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130785536 00000100:00100000:3.0:1789061833.082184:0:6478:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789061833.082202:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061833.082213:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061833.082221:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061833.082228:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061833.082234:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061833.082338:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130785664 00000100:00100000:3.0:1789061833.082341:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130785664 00000100:00100000:3.0:1789061833.082355:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130785792 00000100:00100000:3.0:1789061833.082357:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130785792 00000100:00100000:3.0:1789061833.082365:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130785920 00000100:00100000:3.0:1789061833.082367:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130785920 00000100:00100000:3.0:1789061833.082376:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130786048 00000100:00100000:3.0:1789061833.082378:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130786048 00000100:00100000:3.0:1789061833.082388:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130786176 00000100:00100000:3.0:1789061833.082390:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130786176 00000100:00100000:3.0:1789061833.082400:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789061833.082406:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd6fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+8:10311:x1875967130785536:12345-0@lo:104: 00010000:00010000:3.0:1789061833.082415:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc66b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061833.082448:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789061833.082454:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd6fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+8:10311:x1875967130785536:12345-0@lo:104: Request processed in 48us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061833.082466:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789061833.082499:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789061833.082670:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+7:10311:x1875967130785664:12345-0@lo:104: 00010000:00010000:3.0:1789061833.082678:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6694 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061833.082705:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789061833.082709:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+7:10311:x1875967130785664:12345-0@lo:104: Request processed in 43us (508us total) trans 0 rc 0/0 00010000:00010000:2.0:1789061833.082824:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789061833.082830:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6720 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.082837:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1482200 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061833.082840:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6720 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.082849:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6720 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061833.082855:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6720 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061833.082861:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061833.082891:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6720 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.082898:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061833.082914:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6720 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.082921:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc6719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6720 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.082933:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789061833.082937:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc66f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.082942:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799000 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061833.082945:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc66f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.082953:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc66f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061833.082959:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc66f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061833.082964:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061833.082974:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc66f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.082980:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061833.082992:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc66f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083008:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c3799000/0x2774d8f311dc66ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc66f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083017:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789061833.083020:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc66d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083026:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47be00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061833.083029:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc66d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083035:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc66d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061833.083041:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc66d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061833.083045:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061833.083067:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc66d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083074:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061833.083079:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc66d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083085:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767fd47be00/0x2774d8f311dc66cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc66d3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083093:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789061833.083100:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc66b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083106:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ac00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061833.083109:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc66b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083116:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc66b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061833.083122:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc66b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061833.083127:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061833.083140:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc66b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083145:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061833.083150:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc66b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083156:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767fd47ac00/0x2774d8f311dc66a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc66b0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083166:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061833.083169:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6694 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083175:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030c00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061833.083177:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6694 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083193:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6694 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061833.083199:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6694 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061833.083204:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061833.083215:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6694 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083221:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061833.083225:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6694 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083231:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c0030c00/0x2774d8f311dc668d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6694 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083240:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061833.083242:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061833.083244:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061833.083250:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061833.083256:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061833.083266:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130786304:0@lo:103: 00000100:00100000:2.0:1789061833.083295:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061833.083321:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130786816:0@lo:103: 00000100:00100000:2.0:1789061833.083336:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061833.083351:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789061833.083356:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130786688:0@lo:103: 00000100:00100000:2.0:1789061833.083380:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061833.083400:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130786432:0@lo:103: 00000100:00100000:2.0:1789061833.083417:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061833.083431:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061833.083435:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130786560:0@lo:103: 00000100:00100000:2.0:1789061833.083450:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061833.083470:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130786304 00000100:00100000:2.0:1789061833.083474:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130786304 00010000:00010000:2.0:1789061833.083493:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6719 expref: 24 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061833.083526:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130786816 00000100:00100000:2.0:1789061833.083529:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130786816 00010000:00010000:2.0:1789061833.083540:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6694 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc668d expref: 25 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061833.083548:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130786688 00000100:00100000:2.0:1789061833.083551:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130786688 00010000:00010000:2.0:1789061833.083558:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c3798600/0x2774d8f311dc66b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc66a9 expref: 26 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061833.083567:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130786432 00000100:00100000:2.0:1789061833.083569:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130786432 00010000:00010000:2.0:1789061833.083577:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc66f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc66ef expref: 27 pid: 6488 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061833.083585:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130786560 00000100:00100000:2.0:1789061833.083587:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130786560 00010000:00010000:2.0:1789061833.083604:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c1482600/0x2774d8f311dc66d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc66cc expref: 28 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061833.083644:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789061833.083651:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+28:3621:x1875967130786304:12345-0@lo:103: 00010000:00010000:2.0:1789061833.083661:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061833.083666:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6720 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6719 expref: 28 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083675:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6719 expref: 28 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083688:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6720 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6719 expref: 28 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083701:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061833.083728:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+27:3621:x1875967130786304:12345-0@lo:103: Request processed in 78us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.083734:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789061833.083768:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789061833.083774:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+26:3621:x1875967130786816:12345-0@lo:103: 00010000:00010000:2.0:1789061833.083781:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061833.083785:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6694 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc668d expref: 26 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083793:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc668d expref: 26 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083802:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061833.083821:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+26:3621:x1875967130786816:12345-0@lo:103: Request processed in 48us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.083835:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789061833.083847:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789061833.083855:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+25:3621:x1875967130786688:12345-0@lo:103: 00010000:00010000:2.0:1789061833.083862:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061833.083865:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c3798600/0x2774d8f311dc66b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc66a9 expref: 25 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083873:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c3798600/0x2774d8f311dc66b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc66a9 expref: 25 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083881:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061833.083900:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+25:3621:x1875967130786688:12345-0@lo:103: Request processed in 47us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.083905:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789061833.083916:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789061833.083921:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7506680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130786432:12345-0@lo:103: 00010000:00010000:2.0:1789061833.083928:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061833.083931:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc66f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc66ef expref: 24 pid: 6488 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083937:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc66f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc66ef expref: 24 pid: 6488 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083946:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3799a00/0x2774d8f311dc66f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc66ef expref: 24 pid: 6488 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.083953:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061833.083974:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7506680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:3622:x1875967130786432:12345-0@lo:103: Request processed in 53us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.083985:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789061833.083996:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789061833.084001:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7506d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:3622:x1875967130786560:12345-0@lo:103: 00010000:00010000:2.0:1789061833.084008:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061833.084012:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c1482600/0x2774d8f311dc66d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc66cc expref: 22 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.084019:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c1482600/0x2774d8f311dc66d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc66cc expref: 22 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.084028:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1482600/0x2774d8f311dc66d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc66cc expref: 22 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.084037:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061833.084056:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7506d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3622:x1875967130786560:12345-0@lo:103: Request processed in 55us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.084061:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789061833.084093:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130786688:0@lo:103: 00000100:00100000:2.0:1789061833.084101:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130786304:0@lo:103: 00000100:00100000:2.0:1789061833.084106:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130786816:0@lo:103: 00000100:00100000:2.0:1789061833.084128:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130786560:0@lo:103: 00000100:00100000:2.0:1789061833.084134:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130786432:0@lo:103: 00000100:00100000:0.0:1789061833.084719:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789061833.084731:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+7:10311:x1875967130785792:12345-0@lo:104: 00010000:00010000:0.0:1789061833.084742:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6686 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.084849:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789061833.084855:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+7:10311:x1875967130785792:12345-0@lo:104: Request processed in 129us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061833.084861:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789061833.084881:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789061833.084886:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:10311:x1875967130785920:12345-0@lo:104: 00010000:00010000:0.0:1789061833.084894:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6678 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.084936:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789061833.084941:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:10311:x1875967130785920:12345-0@lo:104: Request processed in 55us (2719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061833.084946:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789061833.084959:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789061833.084965:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:10311:x1875967130786048:12345-0@lo:104: 00010000:00010000:0.0:1789061833.084973:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6639 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.085002:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789061833.085006:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:10311:x1875967130786048:12345-0@lo:104: Request processed in 42us (2778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061833.085012:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789061833.085024:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789061833.085030:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:10311:x1875967130786176:12345-0@lo:104: 00010000:00010000:0.0:1789061833.085036:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc660f expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.085061:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789061833.085066:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:10311:x1875967130786176:12345-0@lo:104: Request processed in 37us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061833.085071:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789061833.085110:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3798600/0x2774d8f311dc66b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc66a9 expref: 20 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.085120:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785536:0@lo:104: 00010000:00010000:0.0:1789061833.085138:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc668d expref: 19 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.085146:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785664:0@lo:104: 00000100:00100000:0.0:1789061833.085153:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785792:0@lo:104: 00000100:00100000:0.0:1789061833.085160:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785920:0@lo:104: 00000100:00100000:0.0:1789061833.085166:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130786048:0@lo:104: 00000100:00100000:0.0:1789061833.085172:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130786176:0@lo:104: 00010000:00010000:2.0:1789061833.085238:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789061833.085244:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6686 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085259:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483000 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061833.085262:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6686 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085269:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6686 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061833.085275:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6686 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061833.085280:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061833.085302:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6686 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085308:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061833.085328:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6686 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085335:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc667f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6686 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085344:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789061833.085347:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6678 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085353:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031400 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061833.085356:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6678 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085372:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6678 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061833.085378:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6678 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061833.085383:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061833.085395:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6678 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085400:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061833.085405:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6678 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085411:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c0031400/0x2774d8f311dc6671 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6678 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085420:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789061833.085423:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6639 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085427:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483e00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061833.085429:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6639 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085435:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6639 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061833.085440:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6639 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061833.085450:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061833.085461:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6639 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085467:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061833.085479:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6639 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085486:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc6632 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6639 expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085494:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061833.085497:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc660f expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061833.085650:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130786944:0@lo:103: 00000100:00100000:0.0:1789061833.085685:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061833.085708:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789061833.085714:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130787072:0@lo:103: 00000100:00100000:0.0:1789061833.085736:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061833.085884:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1482c00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061833.085888:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc660f expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085895:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc660f expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061833.085901:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc660f expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061833.085906:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789061833.085921:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc660f expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085927:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061833.085938:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc660f expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085944:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc6608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc660f expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.085958:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061833.085960:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061833.085962:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061833.085968:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061833.085973:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061833.085984:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130787200:0@lo:103: 00000100:00100000:2.0:1789061833.086010:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061833.086034:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061833.086039:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130787328:0@lo:103: 00000100:00100000:2.0:1789061833.086058:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061833.086082:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130786944 00000100:00100000:2.0:1789061833.086087:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130786944 00010000:00010000:2.0:1789061833.086109:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc667f expref: 19 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061833.086125:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130787072 00000100:00100000:2.0:1789061833.086128:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130787072 00010000:00010000:2.0:1789061833.086138:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6671 expref: 20 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061833.086147:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130787200 00000100:00100000:2.0:1789061833.086149:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130787200 00010000:00010000:2.0:1789061833.086158:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c1483200/0x2774d8f311dc6639 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6632 expref: 21 pid: 6488 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061833.086168:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130787328 00000100:00100000:2.0:1789061833.086175:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130787328 00010000:00010000:2.0:1789061833.086186:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc660f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6608 expref: 22 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061833.086200:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789061833.086207:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:3622:x1875967130786944:12345-0@lo:103: 00010000:00010000:2.0:1789061833.086216:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061833.086221:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc667f expref: 22 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.086230:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc667f expref: 22 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.086242:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc667f expref: 22 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.086253:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061833.086281:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3622:x1875967130786944:12345-0@lo:103: Request processed in 75us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.086287:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789061833.086300:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789061833.086306:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:3622:x1875967130787072:12345-0@lo:103: 00010000:00010000:2.0:1789061833.086312:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061833.086316:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6671 expref: 20 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.086323:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6671 expref: 20 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.086334:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0030800/0x2774d8f311dc6678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6671 expref: 20 pid: 6490 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.086348:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061833.086369:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:3622:x1875967130787072:12345-0@lo:103: Request processed in 64us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.086374:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789061833.086385:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789061833.086390:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:3620:x1875967130787200:12345-0@lo:103: 00010000:00010000:2.0:1789061833.086396:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061833.086400:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c1483200/0x2774d8f311dc6639 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6632 expref: 18 pid: 6488 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.086407:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c1483200/0x2774d8f311dc6639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6632 expref: 18 pid: 6488 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.086415:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1483200/0x2774d8f311dc6639 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6632 expref: 18 pid: 6488 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.086423:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061833.086445:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:3620:x1875967130787200:12345-0@lo:103: Request processed in 55us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.086450:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789061833.086479:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789061833.086485:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:3620:x1875967130787328:12345-0@lo:103: 00010000:00010000:2.0:1789061833.086491:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061833.086495:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc660f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6608 expref: 16 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.086628:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc660f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6608 expref: 16 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.086644:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc660f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6608 expref: 16 pid: 6491 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.086652:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061833.086673:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7505500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:3620:x1875967130787328:12345-0@lo:103: Request processed in 188us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.086678:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789061833.086711:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130787328:0@lo:103: 00000100:00100000:2.0:1789061833.086719:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130787200:0@lo:103: 00000100:00100000:2.0:1789061833.086742:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130787072:0@lo:103: 00000100:00100000:2.0:1789061833.086748:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130786944:0@lo:103: 00000100:00100000:3.0:1789061833.086922:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789061833.087137:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130785024:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061833.090495:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061833.090693:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061833.090766:0:10311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1875967130784896:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061833.091155:0:10311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061833.091378:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120250112 00000100:00100000:2.0:1789061833.091386:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120250112 00010000:00010000:2.0:1789061833.091435:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c74dba00/0x2774d8f311dc672e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6d6 expref: 10 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061833.091467:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120250240 00000100:00100000:2.0:1789061833.091470:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120250240 00010000:00010000:2.0:1789061833.091482:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc6735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6dd expref: 11 pid: 6490 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061833.091514:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:2.0:1789061833.091522:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21c8093b-edf9-482d-a900-a6298c53147f+11:2393:x1875967120250112:12345-192.168.203.3@tcp:103: 00010000:00010000:2.0:1789061833.091535:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061833.091541:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766c74dba00/0x2774d8f311dc672e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6d6 expref: 11 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.091560:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c74dba00/0x2774d8f311dc672e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6d6 expref: 11 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.091575:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c74dba00/0x2774d8f311dc672e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6d6 expref: 11 pid: 6488 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.091589:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061833.091659:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21c8093b-edf9-482d-a900-a6298c53147f+10:2393:x1875967120250112:12345-192.168.203.3@tcp:103: Request processed in 137us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.091667:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:2.0:1789061833.091682:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:2.0:1789061833.091689:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21c8093b-edf9-482d-a900-a6298c53147f+9:2393:x1875967120250240:12345-192.168.203.3@tcp:103: 00010000:00010000:2.0:1789061833.091696:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061833.091701:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc6735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6dd expref: 9 pid: 6490 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.091710:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc6735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6dd expref: 9 pid: 6490 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.091720:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc6735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b6dd expref: 9 pid: 6490 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.091731:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.091739:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.091763:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.091770:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.091967:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.091977:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.091993:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031e00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789061833.091997:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.092005:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.093337:0:10311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061833.093350:0:10311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.093850:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.093861:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc6774 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061833.093879:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061833.094645:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21c8093b-edf9-482d-a900-a6298c53147f+8:2393:x1875967120250240:12345-192.168.203.3@tcp:103: Request processed in 2951us (3947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061833.094655:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:0.0:1789061833.386277:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061833.386301:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130787456:0@lo:13: 00000100:00100000:0.0:1789061833.386364:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061833.386429:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130787456 00000100:00100000:0.0:1789061833.386438:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130787456 00000100:00100000:0.0:1789061833.386487:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789061833.386496:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130787456:12345-0@lo:13: 00002000:00000024:0.0:1789061833.386523:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061833.386580:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130787456:12345-0@lo:13: Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061833.386588:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789061833.386638:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789061833.386663:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676d180 x1875967130787456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061833.386679:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130787456:0@lo:13: 00000100:00100000:0.0:1789061833.390380:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130787584:0@lo:13: 00000100:00100000:0.0:1789061833.390445:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061833.391276:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130787584 00000100:00100000:1.0:1789061833.391287:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130787584 00000100:00100000:1.0:1789061833.391417:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789061833.391427:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130787584:12345-0@lo:13: 00002000:00000024:1.0:1789061833.391452:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789061833.391577:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061833.391801:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130787584:12345-0@lo:13: Request processed in 375us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061833.391809:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1789061833.391868:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b7800 x1875967130787584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061833.391890:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130787584:0@lo:13: 00010000:00010000:2.0:1789061833.513924:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789061834.473715:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789061834.473722:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767fd65c800 from 48 10000000:01000000:3.0:1789061834.473728:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789061834.473775:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061834.473786:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061834.473798:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061834.473821:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130787712:0@lo:101: 00000100:00100000:3.0:1789061834.473913:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.473994:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061834.474106:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130787712 00000100:00100000:2.0:1789061834.474114:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130787712 00000100:00100000:2.0:1789061834.474165:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789061834.474174:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+15:6493:x1875967130787712:12345-0@lo:101: 00010000:00010000:2.0:1789061834.474194:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061834.474217:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c74dae00/0x2774d8f311dc6782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc677b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.474239:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c74dae00/0x2774d8f311dc6782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc677b expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.474249:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c74dae00/0x2774d8f311dc6782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc677b expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.474257:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c74dae00, rc 0) 00000100:00100000:2.0:1789061834.474321:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130787712:12345-0@lo:101: Request processed in 149us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.474327:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789061834.474639:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130787712:0@lo:101: 00010000:00010000:3.0:1789061834.474655:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061834.474664:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061834.474722:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130787840:0@lo:501: 00000100:00100000:3.0:1789061834.474750:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.474773:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736540 going to sleep for 11 seconds 00000100:00100000:0.0:1789061834.476328:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130787840 00000100:00100000:0.0:1789061834.476338:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130787840 00000100:00100000:0.0:1789061834.476393:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789061834.476401:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130787840:12345-0@lo:501: 00000100:00100000:0.0:1789061834.476547:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130787840:12345-0@lo:501: Request processed in 147us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.476555:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789061834.476657:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130787840:0@lo:501: 00000100:00100000:3.0:1789061834.476695:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130787968:0@lo:503: 00000100:00100000:3.0:1789061834.476742:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.476775:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.476834:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130787968 00000100:00100000:1.0:1789061834.476846:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130787968 00000100:00100000:1.0:1789061834.476879:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789061834.476886:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130787968:12345-0@lo:503: 00000100:00100000:1.0:1789061834.476976:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130787968:12345-0@lo:503: Request processed in 90us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.476982:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789061834.477088:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130787968:0@lo:503: 00000100:00100000:0.0:1789061834.478629:0:10328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10328:1875967130788096:0@lo:502: 00000100:00100000:0.0:1789061834.478689:0:10328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061834.478726:0:10328:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5a5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061834.478778:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130788096 00000100:00100000:3.0:1789061834.478785:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130788096 00000100:00100000:3.0:1789061834.478823:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789061834.478831:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:10328:x1875967130788096:12345-0@lo:502: 00000100:00100000:3.0:1789061834.478938:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:10328:x1875967130788096:12345-0@lo:502: Request processed in 108us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061834.478946:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789061834.479092:0:10328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10328:1875967130788096:0@lo:502: 00000100:00100000:0.0:1789061834.479130:0:10328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10328:1875967130788224:0@lo:502: 00000100:00100000:0.0:1789061834.479168:0:10328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061834.479195:0:10328:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5a5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061834.479378:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130788224 00000100:00100000:2.0:1789061834.479383:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130788224 00000100:00100000:2.0:1789061834.479417:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789061834.479424:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:10328:x1875967130788224:12345-0@lo:502: 00000100:00100000:2.0:1789061834.479501:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:10328:x1875967130788224:12345-0@lo:502: Request processed in 77us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.479508:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789061834.479579:0:10328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10328:1875967130788224:0@lo:502: 00000040:00080000:1.0:1789061834.479632:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789061834.479798:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789061834.479823:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789061834.479832:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.479854:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061834.479863:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789061834.479865:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789061834.479869:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789061834.479890:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.479898:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.479905:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061834.479916:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130788352:0@lo:101: 00000100:00100000:2.0:1789061834.479941:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.480046:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.486841:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130788352 00000100:00100000:1.0:1789061834.486855:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130788352 00000100:00100000:1.0:1789061834.486919:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789061834.486930:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+16:6493:x1875967130788352:12345-0@lo:101: 00010000:00010000:1.0:1789061834.486945:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061834.486963:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47b000/0x2774d8f311dc6790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6789 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.486990:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b000/0x2774d8f311dc6790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6789 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.487001:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47b000/0x2774d8f311dc6790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6789 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.487010:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b000, rc 0) 00000100:00100000:1.0:1789061834.487079:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130788352:12345-0@lo:101: Request processed in 151us (7136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.487085:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789061834.487414:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130788352:0@lo:101: 00010000:00010000:2.0:1789061834.487432:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.487441:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061834.487510:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130788480:0@lo:501: 00000100:00100000:2.0:1789061834.487542:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.487602:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.487692:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130788480 00000100:00100000:1.0:1789061834.487697:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130788480 00000100:00100000:1.0:1789061834.487732:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789061834.487738:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130788480:12345-0@lo:501: 00000100:00100000:1.0:1789061834.487851:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130788480:12345-0@lo:501: Request processed in 113us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.487858:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789061834.487961:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130788480:0@lo:501: 00000100:00100000:2.0:1789061834.487986:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130788608:0@lo:503: 00000100:00100000:2.0:1789061834.488023:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.488047:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.488086:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130788608 00000100:00100000:1.0:1789061834.488091:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130788608 00000100:00100000:1.0:1789061834.488117:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789061834.488123:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130788608:12345-0@lo:503: 00000100:00100000:1.0:1789061834.488306:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130788608:12345-0@lo:503: Request processed in 183us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.488314:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789061834.489305:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130788608:0@lo:503: 00000100:00100000:3.0:1789061834.490940:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10329:1875967130788736:0@lo:502: 00000100:00100000:3.0:1789061834.491021:0:10329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.491060:0:10329:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061834.491118:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130788736 00000100:00100000:0.0:1789061834.491125:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130788736 00000100:00100000:0.0:1789061834.491169:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789061834.491177:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:10329:x1875967130788736:12345-0@lo:502: 00000100:00100000:0.0:1789061834.491391:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:10329:x1875967130788736:12345-0@lo:502: Request processed in 215us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.491398:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789061834.491481:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10329:1875967130788736:0@lo:502: 00000020:01000000:3.0:1789061834.491513:0:10329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061834.491521:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061834.491524:0:10329:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789061834.491529:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789061834.491547:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10329:1875967130788864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061834.491578:0:10329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.491639:0:10329:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061834.491809:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130788864 00000100:00100000:0.0:1789061834.491814:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130788864 00000100:00100000:0.0:1789061834.491843:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789061834.491850:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:10329:x1875967130788864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061834.491917:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:10329:x1875967130788864:12345-0@lo:502:llog_process_th.0 Request processed in 67us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.491924:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789061834.494316:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10329:1875967130788864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789061834.494360:0:10329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061834.494369:0:10329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061834.494371:0:10329:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789061834.494375:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1789061834.494545:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789061834.494566:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789061834.494577:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.494632:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061834.494644:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789061834.494647:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767fd12c000 from 48 10000000:01000000:2.0:1789061834.494649:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789061834.494679:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.494686:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.494694:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061834.494713:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130788992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.494759:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.494802:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061834.495111:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130788992 00000100:00100000:0.0:1789061834.495118:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130788992 00000100:00100000:0.0:1789061834.495164:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789061834.495172:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+17:6493:x1875967130788992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061834.495188:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061834.495201:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0031000/0x2774d8f311dc679e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6797 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.495220:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031000/0x2774d8f311dc679e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6797 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.495231:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0031000/0x2774d8f311dc679e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6797 expref: 18 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.495244:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031000, rc 0) 00000100:00100000:0.0:1789061834.495289:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130788992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.495296:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789061834.495537:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130788992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061834.495552:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.495561:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061834.495646:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130789120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.495672:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.495693:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.495745:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130789120 00000100:00100000:1.0:1789061834.495750:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130789120 00000100:00100000:1.0:1789061834.495771:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789061834.495778:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130789120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.495887:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130789120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.495894:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789061834.496060:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130789120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.496084:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130789248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.496122:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.496147:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.496190:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130789248 00000100:00100000:1.0:1789061834.496194:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130789248 00000100:00100000:1.0:1789061834.496221:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789061834.496226:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130789248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.496302:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130789248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.496308:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789061834.496420:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130789248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061834.496757:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10330:1875967130789376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061834.496791:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.496815:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736300 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.496848:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130789376 00000100:00100000:1.0:1789061834.496853:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130789376 00000100:00100000:1.0:1789061834.496881:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789061834.496887:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:10330:x1875967130789376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061834.496968:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:10330:x1875967130789376:12345-0@lo:502:llog_process_th.0 Request processed in 80us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.496975:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789061834.497039:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10330:1875967130789376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061834.497074:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10330:1875967130789504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061834.497104:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.497122:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736300 going to sleep for 11 seconds 00000100:00100000:2.0:1789061834.497161:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130789504 00000100:00100000:2.0:1789061834.497165:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130789504 00000100:00100000:2.0:1789061834.497193:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789061834.497200:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:10330:x1875967130789504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061834.497270:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:10330:x1875967130789504:12345-0@lo:502:llog_process_th.0 Request processed in 70us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.497279:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789061834.497396:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10330:1875967130789504:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789061834.497416:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789061834.497796:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789061834.497814:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789061834.497821:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.497842:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061834.497850:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789061834.497853:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789061834.497856:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789061834.497877:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.497884:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.497892:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061834.497905:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130789632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.497933:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.497993:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b4240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061834.505025:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130789632 00000100:00100000:3.0:1789061834.505039:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130789632 00000100:00100000:2.0:1789061834.505220:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789061834.505232:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+18:6493:x1875967130789632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061834.505248:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061834.505267:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c74da000/0x2774d8f311dc67ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc67a5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.505294:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c74da000/0x2774d8f311dc67ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc67a5 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.505304:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c74da000/0x2774d8f311dc67ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc67a5 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.505325:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c74da000, rc 0) 00000100:00100000:2.0:1789061834.505407:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130789632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (7472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.505414:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789061834.505494:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130789632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061834.505513:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061834.505522:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061834.505603:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130789760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061834.505656:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.515394:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736300 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.515877:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130789760 00000100:00100000:1.0:1789061834.515887:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130789760 00000100:00100000:1.0:1789061834.515940:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789061834.515948:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130789760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.516103:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130789760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (10446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.516111:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789061834.516525:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130789760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061834.516575:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130789888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061834.516656:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.516681:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6736300 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.516933:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130789888 00000100:00100000:1.0:1789061834.516938:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130789888 00000100:00100000:1.0:1789061834.516960:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789061834.516967:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130789888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.517134:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130789888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.517142:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789061834.517905:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130789888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.518321:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10331:1875967130790016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061834.518367:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.518432:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b4000 going to sleep for 11 seconds 00000100:00100000:0.0:1789061834.518624:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130790016 00000100:00100000:0.0:1789061834.518630:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130790016 00000100:00100000:1.0:1789061834.518839:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789061834.518850:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:10331:x1875967130790016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061834.518944:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:10331:x1875967130790016:12345-0@lo:502:llog_process_th.0 Request processed in 96us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.518951:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789061834.519054:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10331:1875967130790016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061834.519077:0:10331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061834.519085:0:10331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061834.519088:0:10331:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789061834.519093:0:10331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789061834.519115:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10331:1875967130790144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061834.519146:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.519176:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.519282:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130790144 00000100:00100000:1.0:1789061834.519287:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130790144 00000100:00100000:1.0:1789061834.521682:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789061834.521702:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:10331:x1875967130790144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061834.521866:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:10331:x1875967130790144:12345-0@lo:502:llog_process_th.0 Request processed in 173us (2719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.521874:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789061834.522188:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10331:1875967130790144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061834.522221:0:10331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061834.522228:0:10331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061834.522230:0:10331:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789061834.522235:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1789061834.522625:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789061834.522646:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789061834.522656:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.522668:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061834.522677:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789061834.522680:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767fb057800 from 48 10000000:01000000:1.0:1789061834.522683:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789061834.522714:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.522722:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.522730:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061834.522750:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130790272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.522792:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061834.522831:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061834.522997:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130790272 00000100:00100000:0.0:1789061834.523004:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130790272 00000100:00100000:0.0:1789061834.523033:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789061834.523041:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:6493:x1875967130790272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061834.523051:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061834.523063:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc67ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc67b3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.523084:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc67ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc67b3 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.523094:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc67ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc67b3 expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.523103:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031e00, rc 0) 00000100:00100000:0.0:1789061834.523135:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130790272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.523141:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789061834.523301:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130790272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061834.523314:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.523324:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061834.523373:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130790400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.523400:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061834.523426:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.523437:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130790400 00000100:00100000:1.0:1789061834.523441:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130790400 00000100:00100000:1.0:1789061834.523457:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789061834.523477:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130790400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.523574:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130790400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.523581:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789061834.523636:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130790400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.523661:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130790528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.523701:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061834.523715:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.523726:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130790528 00000100:00100000:1.0:1789061834.523729:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130790528 00000100:00100000:1.0:1789061834.523744:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789061834.523750:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130790528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.523825:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130790528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.523832:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789061834.523869:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130790528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.524076:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10332:1875967130790656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061834.524107:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061834.524126:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130790656 00000100:00100000:1.0:1789061834.524129:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130790656 00000100:00100000:1.0:1789061834.524145:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789061834.524151:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:10332:x1875967130790656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061834.524373:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:10332:x1875967130790656:12345-0@lo:502:llog_process_th.0 Request processed in 221us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.524379:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789061834.524410:0:10332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c77270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.524421:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10332:1875967130790656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061834.524452:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10332:1875967130790784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061834.527410:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061834.527460:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130790784 00000100:00100000:1.0:1789061834.527477:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130790784 00000100:00100000:1.0:1789061834.527514:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789061834.527522:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:10332:x1875967130790784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061834.527669:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:10332:x1875967130790784:12345-0@lo:502:llog_process_th.0 Request processed in 148us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.527676:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789061834.527722:0:10332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c77270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.527742:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10332:1875967130790784:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789061834.527772:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789061834.527832:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789061834.527851:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789061834.527861:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.527872:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061834.527882:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789061834.527885:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1789061834.527887:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789061834.527914:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.527922:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.527930:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061834.527949:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130790912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.527977:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061834.527990:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.528002:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130790912 00000100:00100000:1.0:1789061834.528005:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130790912 00000100:00100000:1.0:1789061834.528021:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789061834.528027:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130790912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061834.528041:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061834.528054:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc67c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc67c1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.528073:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc67c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc67c1 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.528084:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc67c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc67c1 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.528092:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47aa00, rc 0) 00000100:00100000:1.0:1789061834.528120:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130790912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.528126:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789061834.528154:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130790912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061834.528165:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.528174:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061834.531809:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130791040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.531873:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061834.531921:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061834.532690:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130791040 00000100:00100000:0.0:1789061834.532698:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130791040 00000100:00100000:0.0:1789061834.532748:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789061834.532757:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130791040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061834.532913:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130791040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.532921:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789061834.533164:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130791040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.533267:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130791168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.533313:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061834.533343:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061834.534299:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130791168 00000100:00100000:0.0:1789061834.534305:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130791168 00000100:00100000:0.0:1789061834.534339:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789061834.534346:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130791168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061834.534509:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130791168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.534516:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789061834.536305:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130791168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061834.536874:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10333:1875967130791296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061834.536940:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061834.536979:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061834.537022:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130791296 00000100:00100000:2.0:1789061834.537029:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130791296 00000100:00100000:2.0:1789061834.537072:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789061834.537080:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:10333:x1875967130791296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061834.537210:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:10333:x1875967130791296:12345-0@lo:502:llog_process_th.0 Request processed in 131us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.537218:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789061834.539166:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10333:1875967130791296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789061834.539215:0:10333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061834.539227:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061834.539229:0:10333:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789061834.539235:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789061834.539270:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10333:1875967130791424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061834.539330:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061834.539364:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130791424 00000100:00100000:1.0:1789061834.539370:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130791424 00000100:00100000:1.0:1789061834.539407:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789061834.539415:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:10333:x1875967130791424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061834.539526:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:10333:x1875967130791424:12345-0@lo:502:llog_process_th.0 Request processed in 112us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.539534:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789061834.539576:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.539598:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10333:1875967130791424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789061834.539633:0:10333:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061834.539638:0:10333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061834.539640:0:10333:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789061834.539643:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00010000:00010000:0.0:1789061834.539840:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789061834.540461:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1789061834.540495:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789061834.540505:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.540516:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061834.540527:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789061834.540530:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767c3163000 from 48 10000000:01000000:2.0:1789061834.540533:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789061834.540560:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.540568:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.540578:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061834.540868:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130791552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.540916:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.540943:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061834.540987:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130791552 00000100:00100000:0.0:1789061834.540993:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130791552 00000100:00100000:0.0:1789061834.541028:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789061834.541035:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130791552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061834.541045:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061834.541062:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0030800/0x2774d8f311dc67d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc67cf expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.541083:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0030800/0x2774d8f311dc67d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc67cf expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.541093:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0030800/0x2774d8f311dc67d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc67cf expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.541117:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030800, rc 0) 00000100:00100000:0.0:1789061834.541160:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130791552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.541166:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789061834.541354:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130791552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061834.541368:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.541383:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061834.541435:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130791680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.541461:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.541497:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061834.541565:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130791680 00000100:00100000:0.0:1789061834.541570:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130791680 00000100:00100000:0.0:1789061834.541622:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789061834.541630:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130791680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061834.541738:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130791680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.541746:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789061834.541809:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130791680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.541836:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130791808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.541875:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061834.541897:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061834.543754:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130791808 00000100:00100000:0.0:1789061834.543766:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130791808 00000100:00100000:0.0:1789061834.543818:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789061834.543826:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130791808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061834.543951:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130791808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.543958:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789061834.544069:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130791808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061834.544666:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10334:1875967130791936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061834.544709:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061834.544729:0:10334:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789061834.544804:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130791936 00000100:00100000:0.0:1789061834.544809:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130791936 00000100:00100000:0.0:1789061834.544839:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789061834.544846:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:10334:x1875967130791936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061834.544932:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:10334:x1875967130791936:12345-0@lo:502:llog_process_th.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.544939:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789061834.545006:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10334:1875967130791936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061834.545045:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10334:1875967130792064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061834.545079:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.545102:0:10334:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.545270:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130792064 00000100:00100000:1.0:1789061834.545274:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130792064 00000100:00100000:1.0:1789061834.545305:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789061834.545313:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:10334:x1875967130792064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061834.545380:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:10334:x1875967130792064:12345-0@lo:502:llog_process_th.0 Request processed in 68us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.545387:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789061834.545423:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10334:1875967130792064:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789061834.545440:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789061834.551919:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789061834.551957:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789061834.551969:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.551982:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061834.552132:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789061834.552136:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789061834.552139:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789061834.552176:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.552184:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.552211:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061834.552236:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130792192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.552300:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.552375:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789061834.554805:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130792192 00000100:00100000:1.0:1789061834.554817:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130792192 00000100:00100000:1.0:1789061834.554922:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789061834.554935:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130792192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061834.554954:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061834.554972:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc67e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc67dd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.555001:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc67e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc67dd expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.555014:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc67e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc67dd expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061834.555040:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b600, rc 0) 00000100:00100000:1.0:1789061834.555168:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130792192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (2867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.555175:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789061834.561938:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130792192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061834.561969:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.561981:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061834.562079:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130792320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061834.562136:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061834.562184:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c3714600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061834.562243:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130792320 00000100:00100000:2.0:1789061834.562251:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130792320 00000100:00100000:2.0:1789061834.562305:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789061834.562316:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130792320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.562447:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130792320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.562456:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789061834.562575:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130792320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061834.562633:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130792448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061834.562679:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061834.562694:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c3714600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061834.562741:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130792448 00000100:00100000:2.0:1789061834.562745:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130792448 00000100:00100000:2.0:1789061834.562773:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789061834.562779:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130792448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.562855:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130792448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.562862:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789061834.562901:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130792448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.563065:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10335:1875967130792576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061834.563096:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.563114:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130792576 00000100:00100000:2.0:1789061834.563125:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130792576 00000100:00100000:2.0:1789061834.563142:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789061834.563147:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:10335:x1875967130792576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061834.563216:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:10335:x1875967130792576:12345-0@lo:502:llog_process_th.0 Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.563223:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789061834.563249:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061834.563261:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10335:1875967130792576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061834.563281:0:10335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061834.563288:0:10335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061834.563290:0:10335:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789061834.563296:0:10335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789061834.563314:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10335:1875967130792704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061834.563353:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.563372:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130792704 00000100:00100000:2.0:1789061834.563375:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130792704 00000100:00100000:2.0:1789061834.563390:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789061834.563396:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:10335:x1875967130792704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061834.563446:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:10335:x1875967130792704:12345-0@lo:502:llog_process_th.0 Request processed in 50us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.563452:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789061834.563962:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061834.563976:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10335:1875967130792704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061834.563996:0:10335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061834.564000:0:10335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061834.564001:0:10335:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789061834.564006:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789061834.564067:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1789061834.564086:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789061834.564096:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.564107:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061834.564117:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789061834.564120:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9767f38a8000 from 1 10000000:01000000:2.0:1789061834.564122:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789061834.564146:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74db800/0x2774d8f311dc67eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.564155:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c74db800/0x2774d8f311dc67eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.564164:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c74db800/0x2774d8f311dc67eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061834.564177:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130792832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.564210:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.564225:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d02e7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061834.564236:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130792832 00000100:00100000:2.0:1789061834.564240:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130792832 00000100:00100000:2.0:1789061834.564257:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789061834.564263:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130792832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061834.564271:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061834.564281:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c74db000/0x2774d8f311dc67f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc67eb expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.564313:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c74db000/0x2774d8f311dc67f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc67eb expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.564322:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c74db000/0x2774d8f311dc67f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc67eb expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.564331:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c74db000, rc 0) 00000100:00100000:2.0:1789061834.564358:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130792832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.564364:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789061834.564393:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130792832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061834.564405:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c74db800/0x2774d8f311dc67eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67f2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.564412:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c74db800/0x2774d8f311dc67eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc67f2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061834.564447:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130792960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.564480:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061834.564492:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789061834.564501:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130792960 00000100:00100000:2.0:1789061834.564504:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130792960 00000100:00100000:2.0:1789061834.564517:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789061834.564522:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130792960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.564569:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130792960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 46us (88us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789061834.564583:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789061834.564632:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130792960:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789061834.564648:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789061834.564652:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74db800/0x2774d8f311dc67eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67f2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.564660:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c74db800/0x2774d8f311dc67eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67f2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061834.756713:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061834.756771:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120250368 00000100:00100000:2.0:1789061834.756781:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120250368 00000100:00100000:2.0:1789061834.756836:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 240 00000100:00100000:2.0:1789061834.756845:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+8:6165:x1875967120250368:12345-192.168.203.3@tcp:101: 00010000:00010000:2.0:1789061834.756861:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061834.756879:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c74da600/0x2774d8f311dc67f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b74d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.756904:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c74da600/0x2774d8f311dc67f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b74d expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.756915:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c74da600/0x2774d8f311dc67f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b74d expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061834.756923:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c74da600, rc 0) 00000100:00100000:2.0:1789061834.756980:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+9:6165:x1875967120250368:12345-192.168.203.3@tcp:101: Request processed in 136us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.756987:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 240 00000100:00100000:3.0:1789061834.763936:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061834.763997:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120250496 00000100:00100000:1.0:1789061834.764007:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120250496 00000100:00100000:1.0:1789061834.764063:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:1.0:1789061834.764073:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+9:6165:x1875967120250496:12345-192.168.203.3@tcp:501: 00000100:00100000:1.0:1789061834.764224:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+9:6165:x1875967120250496:12345-192.168.203.3@tcp:501: Request processed in 151us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.764231:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:1.0:1789061834.777067:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061834.777160:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120250624 00000100:00100000:0.0:1789061834.777170:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120250624 00000100:00100000:0.0:1789061834.777221:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00100000:0.0:1789061834.777231:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+9:6165:x1875967120250624:12345-192.168.203.3@tcp:503: 00000100:00100000:0.0:1789061834.777366:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+9:6165:x1875967120250624:12345-192.168.203.3@tcp:503: Request processed in 136us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.777373:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00100000:3.0:1789061834.782653:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061834.782854:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120250752 00000100:00100000:2.0:1789061834.782863:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120250752 00000100:00100000:2.0:1789061834.782921:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00100000:2.0:1789061834.782931:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+9:6645:x1875967120250752:12345-192.168.203.3@tcp:502: 00000100:00100000:2.0:1789061834.783091:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+9:6645:x1875967120250752:12345-192.168.203.3@tcp:502: Request processed in 161us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.783099:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00100000:3.0:1789061834.786437:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061834.786529:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120250880 00000100:00100000:1.0:1789061834.786539:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120250880 00000100:00100000:1.0:1789061834.786604:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00100000:1.0:1789061834.786651:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+9:6645:x1875967120250880:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061834.786786:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+9:6645:x1875967120250880:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 137us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.786794:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00100000:1.0:1789061834.792555:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061834.792651:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120251008 00000100:00100000:0.0:1789061834.792662:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120251008 00000100:00100000:0.0:1789061834.792715:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 245 00000100:00100000:0.0:1789061834.792724:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+9:6165:x1875967120251008:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061834.792740:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061834.792771:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b754 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.792798:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b754 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.792808:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b754 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061834.792816:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031c00, rc 0) 00000100:00100000:0.0:1789061834.792870:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+10:6165:x1875967120251008:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 147us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.792876:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 245 00000100:00100000:3.0:1789061834.802810:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061834.802906:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120251136 00000100:00100000:2.0:1789061834.802915:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120251136 00000100:00100000:2.0:1789061834.802980:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 246 00000100:00100000:2.0:1789061834.802990:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:6165:x1875967120251136:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061834.803105:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:6165:x1875967120251136:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 117us (304us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789061834.803113:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 246 00000100:00100000:3.0:1789061834.922438:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130793216:0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.922502:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.922568:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130793728:0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.922625:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.922645:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130794240:0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.922664:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.922687:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789061834.922692:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130793088:0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.922719:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.922736:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130793600:0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.922758:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.922772:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130794112:0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.922792:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061834.922804:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130794624:0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.922820:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061834.923000:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130793216 00000100:00100000:1.0:1789061834.923008:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130793216 00000100:00100000:1.0:1789061834.923055:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130793728 00000100:00100000:1.0:1789061834.923059:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130793728 00000100:00100000:1.0:1789061834.923087:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130794240 00000100:00100000:1.0:1789061834.923089:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130794240 00000100:00100000:1.0:1789061834.923128:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789061834.923136:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130793216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061834.923187:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130793216:12345-0@lo:400:kworker.0 Request processed in 51us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.923194:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789061834.923212:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789061834.923219:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130793728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061834.923246:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130793728:12345-0@lo:400:kworker.0 Request processed in 29us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.923252:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789061834.923263:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789061834.923269:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130794240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061834.923295:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130794240:12345-0@lo:400:kworker.0 Request processed in 27us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.923301:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789061834.923324:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130793600 00000100:00100000:1.0:1789061834.923328:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130793600 00000100:00100000:1.0:1789061834.923349:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789061834.923355:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130793600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061834.923382:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130793600:12345-0@lo:400:kworker.0 Request processed in 27us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.923387:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789061834.923403:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130794112 00000100:00100000:1.0:1789061834.923406:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130794112 00000100:00100000:1.0:1789061834.923427:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130794624 00000100:00100000:1.0:1789061834.923429:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130794624 00000100:00100000:1.0:1789061834.923447:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789061834.923463:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130794112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061834.923492:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130794112:12345-0@lo:400:kworker.0 Request processed in 31us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.923497:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789061834.923507:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789061834.923512:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130794624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061834.923536:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130794624:12345-0@lo:400:kworker.0 Request processed in 24us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.923541:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789061834.923745:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130793600:0@lo:400:kworker.0 00010000:00080000:3.0:1789061834.923757:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd43d500 x1875967130794112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061834.923767:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130794112:0@lo:400:kworker.0 00010000:00080000:3.0:1789061834.923775:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd43ca80 x1875967130794624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061834.923784:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130794624:0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.923792:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130793216:0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.923800:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130793728:0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.923807:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130794240:0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.923864:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130793088 00000100:00100000:3.0:1789061834.923869:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130793088 00000100:00100000:3.0:1789061834.923907:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789061834.923914:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130793088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.923952:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130793088:12345-0@lo:400:kworker.0 Request processed in 38us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061834.923958:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789061834.923989:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130793088:0@lo:400:kworker.0 00000100:00080000:3.0:1789061834.924011:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061834.924016:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061834.924281:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130793344:0@lo:400:kworker.0 00000100:00100000:0.0:1789061834.924315:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061834.924343:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130793856:0@lo:400:kworker.0 00000100:00100000:0.0:1789061834.924365:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061834.924377:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130794368:0@lo:400:kworker.0 00000100:00100000:0.0:1789061834.924394:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061834.924411:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789061834.924416:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130793472:0@lo:400:kworker.0 00000100:00100000:0.0:1789061834.924435:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061834.924449:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130793984:0@lo:400:kworker.0 00000100:00100000:0.0:1789061834.924468:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061834.924481:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130794496:0@lo:400:kworker.0 00000100:00100000:0.0:1789061834.924498:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061834.924547:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130793984 00000100:00100000:0.0:1789061834.924562:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130793984 00000100:00100000:0.0:1789061834.924597:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130794496 00000100:00100000:0.0:1789061834.924600:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130794496 00000100:00100000:0.0:1789061834.924646:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789061834.924653:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130793984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061834.924690:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130793984:12345-0@lo:400:kworker.0 Request processed in 37us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.924695:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789061834.924705:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789061834.924711:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130794496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061834.924735:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130794496:12345-0@lo:400:kworker.0 Request processed in 25us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061834.924740:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789061834.924755:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789061834.924773:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd43d180 x1875967130793984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061834.924783:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130793984:0@lo:400:kworker.0 00010000:00080000:0.0:1789061834.924792:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd43df80 x1875967130794496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061834.924798:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130794496:0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.924992:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130793344 00000100:00100000:3.0:1789061834.924997:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130793344 00000100:00100000:3.0:1789061834.925028:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789061834.925034:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130793344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061834.925069:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130793344:12345-0@lo:400:kworker.0 Request processed in 36us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061834.925075:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789061834.925261:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130793856 00000100:00100000:1.0:1789061834.925266:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130793856 00000100:00100000:1.0:1789061834.925334:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130794368 00000100:00100000:1.0:1789061834.925337:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130794368 00000100:00100000:2.0:1789061834.925368:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130793472 00000100:00100000:2.0:1789061834.925372:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130793472 00000100:00100000:2.0:1789061834.925394:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789061834.925400:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130793856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061834.925430:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130793856:12345-0@lo:400:kworker.0 Request processed in 31us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.925436:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789061834.925445:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789061834.925450:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130793472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061834.925469:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130793472:12345-0@lo:400:kworker.0 Request processed in 19us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061834.925473:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789061834.925576:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130793472:0@lo:400:kworker.0 00000100:00100000:0.0:1789061834.925595:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130793344:0@lo:400:kworker.0 00010000:00080000:0.0:1789061834.925626:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd43ed80 x1875967130793856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061834.925647:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130793856:0@lo:400:kworker.0 00000100:00080000:3.0:1789061834.925775:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061834.925882:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789061834.925889:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130794368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061834.925940:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130794368:12345-0@lo:400:kworker.0 Request processed in 52us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061834.925945:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1789061834.926006:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd43ce00 x1875967130794368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061834.926016:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130794368:0@lo:400:kworker.0 00000100:00100000:3.0:1789061835.433851:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061835.433874:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130794752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061835.433937:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061835.434006:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130794752 00000100:00100000:3.0:1789061835.434014:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130794752 00000100:00100000:3.0:1789061835.434061:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789061835.434070:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130794752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061835.434111:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061835.434155:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130794752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061835.434646:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061835.434656:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130794880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061835.434686:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789061835.434820:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b7800 x1875967130794752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061835.434839:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130794752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061835.435218:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789061835.435238:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130794880 00000100:00100000:3.0:1789061835.435243:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130794880 00000100:00100000:3.0:1789061835.435264:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789061835.435271:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130794880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789061835.435284:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061835.435321:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130794880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061835.435327:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789061835.436136:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676f800 x1875967130794880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061835.436154:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130794880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061835.440920:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130795008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061835.440984:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061835.441082:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130795008 00000100:00100000:2.0:1789061835.441230:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130795008 00000100:00100000:2.0:1789061835.441326:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789061835.441336:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130795008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789061835.441367:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789061835.441419:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130795008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061835.441426:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789061835.441497:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130795008:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789061835.562752:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789061836.576212:0:10372:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd86d01520 20000000:00000080:0.0:1789061836.576228:0:10372:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9766c6703000 uarg=0000000000000000 20000000:01000000:0.0:1789061836.576265:0:10372:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789061836.576270:0:10372:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789061836.576274:0:10372:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789061836.577697:0:10373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789061836.577873:0:10372:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789061836.582811:0:10372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789061836.582843:0:10372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789061836.582857:0:10372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789061836.582872:0:10372:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789061836.582890:0:10372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.582912:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc64a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc649c expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.582921:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c3798200/0x2774d8f311dc64b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc64aa expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.582941:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767fd47a200/0x2774d8f311dc6505 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc64fe expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.582948:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c0030600/0x2774d8f311dc662b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6624 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.582958:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6743 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b715 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.582965:0:10372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.583012:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6743 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b715 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.583029:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6743 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b715 expref: 9 pid: 6491 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061836.583045:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875967130795136:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061836.583221:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c0030600/0x2774d8f311dc662b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6624 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.583230:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c0030600/0x2774d8f311dc662b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6624 expref: 23 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061836.583240:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875967130795264:0@lo:104: 00000100:00100000:1.0:1789061836.583276:0:10372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789061836.583307:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767fd47a200/0x2774d8f311dc6505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc64fe expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.583321:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767fd47a200/0x2774d8f311dc6505 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc64fe expref: 23 pid: 6491 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061836.583330:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875967130795392:0@lo:104: 00000100:00100000:1.0:1789061836.583353:0:10372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789061836.583371:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c3798200/0x2774d8f311dc64b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc64aa expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.583379:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c3798200/0x2774d8f311dc64b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc64aa expref: 23 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061836.583387:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875967130795520:0@lo:104: 00010000:00010000:1.0:1789061836.583406:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc64a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc649c expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.583414:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc64a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc649c expref: 23 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061836.583422:0:10372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875967130795648:0@lo:104: 00000100:00100000:1.0:1789061836.583437:0:10372:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789061836.583473:0:7437:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789061836.583488:0:7437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061836.583503:0:7437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061836.583511:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130795264 00000100:00100000:1.0:1789061836.583517:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130795264 00000100:00100000:1.0:1789061836.583549:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130795392 00000100:00100000:1.0:1789061836.583553:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130795392 00000100:00100000:1.0:1789061836.583563:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130795520 00000100:00100000:1.0:1789061836.583565:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130795520 00000100:00100000:1.0:1789061836.583709:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130795648 00000100:00100000:1.0:1789061836.583713:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130795648 00000100:00100000:3.0:1789061836.583726:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789061836.583738:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:10372:x1875967130795264:12345-0@lo:104: 00010000:00010000:3.0:1789061836.583752:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc662b expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061836.583806:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789061836.583813:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:10372:x1875967130795264:12345-0@lo:104: Request processed in 79us (536us total) trans 0 rc 0/0 00010000:00010000:2.0:1789061836.583892:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061836.583900:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc662b expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.583908:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483600 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061836.583912:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc662b expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.583921:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc662b expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061836.583929:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc662b expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061836.583935:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789061836.583960:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc662b expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.583966:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061836.583983:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc662b expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584002:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1483600/0x2774d8f311dc6624 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc662b expref: -99 pid: 9488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584014:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061836.584016:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061836.584018:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061836.584224:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789061836.584232:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd352450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:10372:x1875967130795392:12345-0@lo:104: 00010000:00010000:1.0:1789061836.584241:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6505 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.584284:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789061836.584290:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd352450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+6:10372:x1875967130795392:12345-0@lo:104: Request processed in 60us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061836.584296:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789061836.584313:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789061836.584319:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:10372:x1875967130795520:12345-0@lo:104: 00010000:00010000:1.0:1789061836.584327:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc64b1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.584353:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789061836.584358:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:10372:x1875967130795520:12345-0@lo:104: Request processed in 40us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061836.584364:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789061836.584374:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789061836.584380:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:10372:x1875967130795648:12345-0@lo:104: 00010000:00010000:1.0:1789061836.584386:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767fd47ba00/0x2774d8f311dc649c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc64a3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.584408:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789061836.584413:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:10372:x1875967130795648:12345-0@lo:104: Request processed in 34us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061836.584427:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789061836.584464:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875967130795264:0@lo:104: 00000100:00100000:1.0:1789061836.584472:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875967130795392:0@lo:104: 00000100:00100000:1.0:1789061836.584478:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875967130795520:0@lo:104: 00000100:00100000:1.0:1789061836.584484:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875967130795648:0@lo:104: 00000100:00100000:1.0:1789061836.584509:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130795776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061836.584537:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789061836.584731:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789061836.584737:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6505 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584744:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799200 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061836.584748:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6505 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584756:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6505 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061836.584763:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6505 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061836.584769:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789061836.584790:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6505 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584795:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061836.584806:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6505 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584813:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c3799200/0x2774d8f311dc64fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6505 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584828:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789061836.584832:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc64b1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584838:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b800 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061836.584841:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc64b1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584848:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc64b1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061836.584854:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc64b1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061836.584859:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789061836.584870:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc64b1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584875:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061836.584890:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc64b1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584896:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767fd47b800/0x2774d8f311dc64aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc64b1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584904:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061836.584907:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767fd47ba00/0x2774d8f311dc649c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc64a3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584922:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ba00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061836.584925:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47ba00/0x2774d8f311dc649c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc64a3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584932:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767fd47ba00/0x2774d8f311dc649c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc64a3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061836.584939:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47ba00/0x2774d8f311dc649c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc64a3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061836.584944:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789061836.584954:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767fd47ba00/0x2774d8f311dc649c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc64a3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584960:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061836.584965:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767fd47ba00/0x2774d8f311dc649c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc64a3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584972:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767fd47ba00/0x2774d8f311dc649c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc64a3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.584983:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061836.584984:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061836.584986:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061836.585301:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130795776 00000100:00100000:1.0:1789061836.585307:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130795776 00010000:00010000:1.0:1789061836.585328:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c0030600/0x2774d8f311dc662b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6624 expref: 24 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061836.585349:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789061836.585355:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130795776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061836.585366:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061836.585370:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c0030600/0x2774d8f311dc662b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6624 expref: 24 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.585380:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c0030600/0x2774d8f311dc662b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6624 expref: 24 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.585392:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0030600/0x2774d8f311dc662b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6624 expref: 24 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.585404:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061836.585430:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:3620:x1875967130795776:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061836.585446:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789061836.585465:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130795904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061836.585488:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061836.585513:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130795904 00000100:00100000:1.0:1789061836.585516:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130795904 00010000:00010000:1.0:1789061836.585528:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767fd47a200/0x2774d8f311dc6505 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc64fe expref: 23 pid: 6491 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061836.585560:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061836.585717:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789061836.585725:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:3621:x1875967130795904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061836.585733:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061836.585737:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767fd47a200/0x2774d8f311dc6505 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc64fe expref: 23 pid: 6491 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.585746:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767fd47a200/0x2774d8f311dc6505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc64fe expref: 23 pid: 6491 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.585756:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47a200/0x2774d8f311dc6505 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc64fe expref: 23 pid: 6491 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.585765:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061836.585790:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:3621:x1875967130795904:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061836.585796:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789061836.585829:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130795904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061836.585853:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130796160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061836.585873:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061836.585902:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061836.585907:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130796032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061836.585926:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061836.585943:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130796160 00000100:00100000:1.0:1789061836.585946:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130796160 00010000:00010000:1.0:1789061836.585970:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc64a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc649c expref: 22 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061836.585982:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130796032 00000100:00100000:1.0:1789061836.585984:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130796032 00010000:00010000:1.0:1789061836.586131:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c3798200/0x2774d8f311dc64b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc64aa expref: 23 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061836.586146:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789061836.586153:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:3623:x1875967130796160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061836.586160:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061836.586164:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc64a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc649c expref: 23 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.586172:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc64a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc649c expref: 23 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.586183:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc64a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc649c expref: 23 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.586191:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061836.586216:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:3623:x1875967130796160:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061836.586222:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789061836.586233:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789061836.586245:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3623:x1875967130796032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061836.586252:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061836.586256:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c3798200/0x2774d8f311dc64b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc64aa expref: 21 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.586264:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c3798200/0x2774d8f311dc64b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc64aa expref: 21 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.586274:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3798200/0x2774d8f311dc64b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc64aa expref: 21 pid: 6490 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.586283:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061836.586301:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:3623:x1875967130796032:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061836.586306:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789061836.586351:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130796032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061836.586358:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130796160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061836.586775:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130795776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789061836.586790:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061836.587953:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061836.588788:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789061836.594053:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061836.594247:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120251264 00000100:00100000:0.0:1789061836.594268:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120251264 00010000:00010000:0.0:1789061836.594302:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6743 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b715 expref: 10 pid: 6491 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061836.594344:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:0.0:1789061836.594353:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21c8093b-edf9-482d-a900-a6298c53147f+10:2392:x1875967120251264:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061836.594366:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061836.594372:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6743 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b715 expref: 10 pid: 6491 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061836.594384:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6743 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b715 expref: 10 pid: 6491 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061836.594404:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061836.594414:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061836.594441:0:9499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061836.594450:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061836.594457:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061836.594469:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061836.594475:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a000 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789061836.594485:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061836.594494:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061836.594503:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061836.594523:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061836.594580:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21c8093b-edf9-482d-a900-a6298c53147f+10:2392:x1875967120251264:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 219us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061836.594588:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00010000:00010000:1.0:1789061836.598667:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0030400/0x2774d8f311dc6743 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b715 expref: 9 pid: 6491 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061836.598688:0:10372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1875967130795136:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061836.598723:0:10372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.598734:0:10372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.598741:0:10372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061836.598764:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc6807 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061837.618589:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061837.995438:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130796288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061837.995502:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061837.995603:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130796288 00000100:00100000:0.0:1789061837.995634:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130796288 00000100:00100000:0.0:1789061837.995680:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789061837.995688:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130796288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789061837.995718:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789061837.995762:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130796288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061837.995768:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789061837.995816:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130796288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061838.086436:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061838.086476:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061838.086502:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061838.086535:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061838.086558:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061838.086595:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120251392 00000100:00100000:3.0:1789061838.086619:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120251392 00000100:00100000:3.0:1789061838.086671:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 248 00000100:00100000:3.0:1789061838.086682:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+9:2390:x1875967120251392:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061838.086746:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+9:2390:x1875967120251392:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 65us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061838.086754:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 248 00000100:00100000:3.0:1789061838.086785:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120251776 00000100:00100000:3.0:1789061838.086789:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120251776 00000100:00100000:3.0:1789061838.086831:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120251904 00000100:00100000:3.0:1789061838.086834:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120251904 00000100:00100000:3.0:1789061838.086855:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1789061838.086862:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120251776:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061838.086888:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120251776:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061838.086894:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1789061838.086906:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:3.0:1789061838.086912:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120251904:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061838.086934:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120251904:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061838.086939:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:3.0:1789061838.086956:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120251520 00000100:00100000:3.0:1789061838.086959:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120251520 00000100:00100000:3.0:1789061838.087196:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120251648 00000100:00100000:3.0:1789061838.087200:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120251648 00000100:00100000:3.0:1789061838.087218:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:3.0:1789061838.087222:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120251520:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061838.087242:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120251520:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061838.087251:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:3.0:1789061838.087260:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:3.0:1789061838.087263:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120251648:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061838.087278:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120251648:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 15us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061838.087281:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00080000:3.0:1789061838.087373:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789061838.087375:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061838.087377:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061838.087378:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1789061838.314112:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789061838.314118:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fd65c800 from 4 10000000:01000000:2.0:1789061838.314122:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061838.314231:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.314244:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.314674:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061838.314698:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130796416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.314754:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.314800:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa840 going to sleep for 11 seconds 00000100:00100000:1.0:1789061838.314849:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130796416 00000100:00100000:1.0:1789061838.314856:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130796416 00000100:00100000:1.0:1789061838.314906:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789061838.314915:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130796416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061838.314928:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061838.314951:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6815 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc680e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061838.314973:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc680e expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061838.315079:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc680e expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061838.315089:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b200, rc 0) 00000100:00100000:1.0:1789061838.315187:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130796416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 272us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061838.315193:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789061838.317122:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130796416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061838.317157:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6815 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.317168:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6815 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061838.317248:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130796544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.317296:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.317333:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.317354:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130796544 00000100:00100000:2.0:1789061838.317361:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130796544 00000100:00100000:2.0:1789061838.317406:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789061838.317413:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130796544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.317525:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130796544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.317532:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789061838.317580:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130796544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.317625:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130796672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.317665:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.317681:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.317693:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130796672 00000100:00100000:2.0:1789061838.317696:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130796672 00000100:00100000:2.0:1789061838.317717:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789061838.317722:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130796672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.317795:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130796672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.317802:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789061838.317840:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130796672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.320337:0:10427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10427:1875967130796800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.320407:0:10427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.320444:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130796800 00000100:00100000:2.0:1789061838.320451:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130796800 00000100:00100000:2.0:1789061838.320489:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789061838.320497:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:10427:x1875967130796800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.320625:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:10427:x1875967130796800:12345-0@lo:502:llog_process_th.0 Request processed in 128us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.320637:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789061838.320681:0:10427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa000 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.320698:0:10427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10427:1875967130796800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061838.320725:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061838.320734:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061838.320736:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789061838.320742:0:10427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767fd65c800 00000020:00000080:2.0:1789061838.320745:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789061838.329585:0:10427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10427:1875967130796928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.329678:0:10427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.329718:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130796928 00000100:00100000:2.0:1789061838.329724:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130796928 00000100:00100000:2.0:1789061838.329766:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789061838.329773:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:10427:x1875967130796928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.329874:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:10427:x1875967130796928:12345-0@lo:502:llog_process_th.0 Request processed in 100us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.329882:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789061838.331074:0:10427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa480 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.331106:0:10427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10427:1875967130796928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061838.331145:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061838.331154:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061838.331157:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789061838.331162:0:10427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789061838.331239:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789061838.331260:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061838.331270:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6815 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.331290:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6815 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061838.331300:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789061838.331302:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fd12c000 from 4 10000000:01000000:2.0:1789061838.331305:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061838.331332:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.331340:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.331349:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061838.331365:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130797056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.331408:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.331428:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa480 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.331447:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130797056 00000100:00100000:2.0:1789061838.331452:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130797056 00000100:00100000:2.0:1789061838.331484:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789061838.331493:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130797056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061838.331503:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061838.331515:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6823 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc681c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.331535:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc681c expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.331556:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc681c expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.331576:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c74da200, rc 0) 00000100:00100000:2.0:1789061838.331629:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130797056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.331636:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789061838.331672:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130797056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061838.331683:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6823 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.331691:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6823 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061838.331733:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130797184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.331757:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.331770:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa480 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.331781:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130797184 00000100:00100000:2.0:1789061838.331784:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130797184 00000100:00100000:2.0:1789061838.331805:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789061838.331811:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130797184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.331907:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130797184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.331913:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789061838.331940:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130797184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.331973:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130797312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.336156:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.336206:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa480 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.336234:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130797312 00000100:00100000:2.0:1789061838.336243:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130797312 00000100:00100000:2.0:1789061838.336285:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789061838.336294:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130797312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.336412:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130797312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.336420:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789061838.336475:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130797312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061838.350804:0:10430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10430:1875967130797440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061838.350882:0:10430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061838.350917:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130797440 00000100:00100000:1.0:1789061838.350924:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130797440 00000100:00100000:1.0:1789061838.350989:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789061838.350998:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:10430:x1875967130797440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061838.351109:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:10430:x1875967130797440:12345-0@lo:502:llog_process_th.0 Request processed in 111us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061838.351116:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789061838.351161:0:10430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789061838.351182:0:10430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10430:1875967130797440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789061838.351208:0:10430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061838.351216:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061838.351219:0:10430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789061838.351224:0:10430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767fd12c000 00000020:00000080:1.0:1789061838.351227:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789061838.351283:0:10430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10430:1875967130797568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061838.351312:0:10430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061838.351324:0:10430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.352156:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130797568 00000100:00100000:2.0:1789061838.352163:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130797568 00000100:00100000:2.0:1789061838.352196:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789061838.352205:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:10430:x1875967130797568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.352295:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:10430:x1875967130797568:12345-0@lo:502:llog_process_th.0 Request processed in 93us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.352302:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789061838.355355:0:10430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10430:1875967130797568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789061838.355397:0:10430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061838.355404:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061838.355406:0:10430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789061838.355412:0:10430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789061838.358112:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789061838.358154:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061838.358165:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6823 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.358177:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6823 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061838.358200:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789061838.358203:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fb057800 from 4 10000000:01000000:2.0:1789061838.358206:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061838.358241:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.358248:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.358258:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061838.358280:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130797696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.358344:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.358382:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd3e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.358400:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130797696 00000100:00100000:2.0:1789061838.358406:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130797696 00000100:00100000:2.0:1789061838.358442:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789061838.358449:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130797696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061838.358461:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061838.358474:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c1483600/0x2774d8f311dc6831 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc682a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.358494:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1483600/0x2774d8f311dc6831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc682a expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.358504:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c1483600/0x2774d8f311dc6831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc682a expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.358522:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c1483600, rc 0) 00000100:00100000:2.0:1789061838.358554:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130797696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.358570:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789061838.358628:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130797696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061838.358641:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6831 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.358650:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6831 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061838.358710:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130797824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.358732:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.358744:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd3e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.358755:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130797824 00000100:00100000:2.0:1789061838.358758:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130797824 00000100:00100000:2.0:1789061838.358777:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789061838.358782:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130797824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.358873:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130797824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.358879:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789061838.358907:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130797824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.358929:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130797952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.358960:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.360199:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd3e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.360221:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130797952 00000100:00100000:2.0:1789061838.360227:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130797952 00000100:00100000:2.0:1789061838.360262:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789061838.360269:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130797952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.361116:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130797952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 843us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.361125:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789061838.361184:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130797952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.361420:0:10433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10433:1875967130798080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.361455:0:10433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.361475:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130798080 00000100:00100000:2.0:1789061838.361479:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130798080 00000100:00100000:2.0:1789061838.361499:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789061838.361505:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:10433:x1875967130798080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.361586:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:10433:x1875967130798080:12345-0@lo:502:llog_process_th.0 Request processed in 80us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.361592:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789061838.361635:0:10433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7482600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.361648:0:10433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10433:1875967130798080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061838.361668:0:10433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061838.361676:0:10433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061838.361679:0:10433:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789061838.361685:0:10433:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767fb057800 00000020:00000080:2.0:1789061838.361688:0:10433:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789061838.366225:0:10433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10433:1875967130798208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.366311:0:10433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.366367:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130798208 00000100:00100000:2.0:1789061838.366374:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130798208 00000100:00100000:2.0:1789061838.366417:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789061838.366427:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:10433:x1875967130798208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.366527:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:10433:x1875967130798208:12345-0@lo:502:llog_process_th.0 Request processed in 101us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.366535:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789061838.366595:0:10433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7482600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.366632:0:10433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10433:1875967130798208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061838.366659:0:10433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061838.366666:0:10433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061838.366668:0:10433:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789061838.366672:0:10433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789061838.366731:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789061838.366752:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061838.366761:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6831 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.366771:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6831 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061838.366781:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789061838.366784:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767c3163000 from 4 10000000:01000000:2.0:1789061838.366786:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061838.366807:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.366814:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.366829:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061838.366843:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130798336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.366869:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.366883:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7482600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.366896:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130798336 00000100:00100000:2.0:1789061838.366899:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130798336 00000100:00100000:2.0:1789061838.366920:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789061838.366927:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130798336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061838.366934:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061838.366946:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc683f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6838 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.366965:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc683f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6838 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.366974:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc683f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6838 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.372091:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c1482c00, rc 0) 00000100:00100000:2.0:1789061838.372170:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130798336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5240us (5297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.372179:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789061838.372262:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130798336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061838.372284:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc683f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.372302:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc683f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061838.372374:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130798464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.372402:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.372428:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7482600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.372445:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130798464 00000100:00100000:2.0:1789061838.372450:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130798464 00000100:00100000:2.0:1789061838.372480:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789061838.372487:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130798464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.372596:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130798464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.372603:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789061838.372650:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130798464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.372675:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130798592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.372712:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.372724:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7482600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.372736:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130798592 00000100:00100000:2.0:1789061838.372739:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130798592 00000100:00100000:2.0:1789061838.372758:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789061838.372763:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130798592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.372830:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130798592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.372837:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789061838.372879:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130798592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.383771:0:10435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10435:1875967130798720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.383846:0:10435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.383881:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130798720 00000100:00100000:2.0:1789061838.383888:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130798720 00000100:00100000:2.0:1789061838.383928:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789061838.383948:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:10435:x1875967130798720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.384062:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:10435:x1875967130798720:12345-0@lo:502:llog_process_th.0 Request processed in 126us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.384070:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789061838.384118:0:10435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7482600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.384137:0:10435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10435:1875967130798720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061838.384163:0:10435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061838.384171:0:10435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061838.384173:0:10435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789061838.384180:0:10435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767c3163000 00000020:00000080:2.0:1789061838.384183:0:10435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789061838.384495:0:10435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10435:1875967130798848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.384529:0:10435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061838.384549:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130798848 00000100:00100000:2.0:1789061838.384553:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130798848 00000100:00100000:2.0:1789061838.384587:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789061838.384593:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:10435:x1875967130798848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061838.384681:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:10435:x1875967130798848:12345-0@lo:502:llog_process_th.0 Request processed in 87us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.384687:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789061838.384725:0:10435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd526840 going to sleep for 11 seconds 00000100:00100000:2.0:1789061838.384737:0:10435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:10435:1875967130798848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061838.384756:0:10435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061838.384761:0:10435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061838.384762:0:10435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789061838.384766:0:10435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789061838.384820:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789061838.384837:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061838.384845:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc683f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061838.384856:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc683f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061838.505851:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061838.505873:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130798976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061838.505937:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061838.506083:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061838.506094:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130799104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061838.506123:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061838.506154:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130798976 00000100:00100000:1.0:1789061838.506161:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130798976 00000100:00100000:1.0:1789061838.506199:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130799104 00000100:00100000:1.0:1789061838.506202:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130799104 00000100:00100000:1.0:1789061838.506216:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789061838.506224:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130798976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061838.506260:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061838.506294:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130798976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061838.506300:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789061838.506316:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789061838.506322:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130799104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789061838.506330:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061838.506355:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130799104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061838.506361:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789061838.506433:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789061838.506550:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676ce00 x1875967130798976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061838.506578:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130798976:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789061838.506720:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd43f100 x1875967130799104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061838.506732:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130799104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789061838.597503:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061838.597831:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120252032 00000100:00100000:0.0:1789061838.597844:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120252032 00000100:00100000:0.0:1789061838.597921:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 269 00000100:00100000:0.0:1789061838.597933:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+9:6165:x1875967120252032:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061838.597951:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061838.597972:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc6846 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b75b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061838.599172:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc6846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b75b expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061838.599185:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc6846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b75b expref: 10 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061838.599194:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030c00, rc 0) 00000100:00100000:0.0:1789061838.599249:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:6165:x1875967120252032:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 1319us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061838.599256:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 269 00000100:00100000:3.0:1789061838.607722:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061838.609675:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120252160 00000100:00100000:2.0:1789061838.609690:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120252160 00000100:00100000:2.0:1789061838.609757:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 270 00000100:00100000:2.0:1789061838.609769:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+10:6165:x1875967120252160:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061838.609908:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+10:6165:x1875967120252160:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 142us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061838.609915:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 270 00000100:00100000:3.0:1789061838.620413:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061838.620704:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120252288 00000100:00100000:0.0:1789061838.620717:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120252288 00000100:00100000:0.0:1789061838.620788:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 271 00000100:00100000:0.0:1789061838.620801:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:6165:x1875967120252288:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061838.621010:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:6165:x1875967120252288:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 211us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061838.621019:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 271 00000100:00100000:3.0:1789061838.633758:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061838.633850:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120252416 00000100:00100000:0.0:1789061838.633868:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120252416 00010000:00010000:2.0:1789061838.634201:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061838.634259:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 272 00000100:00100000:1.0:1789061838.634276:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:6709:x1875967120252416:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061838.634511:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:6709:x1875967120252416:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 238us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061838.634520:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 272 00000100:00100000:3.0:1789061838.643725:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061838.644203:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120252544 00000100:00100000:0.0:1789061838.644213:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120252544 00000100:00100000:0.0:1789061838.644267:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 273 00000100:00100000:0.0:1789061838.644278:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:6709:x1875967120252544:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789061838.644428:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:6709:x1875967120252544:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 150us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061838.644435:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 273 00010000:00010000:2.0:1789061839.659047:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061840.042868:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130799488:0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.042969:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061840.043040:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130800000:0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.043068:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061840.043088:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130800512:0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.043112:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061840.043141:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789061840.043147:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130799360:0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.043170:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061840.043189:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130799872:0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.043212:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061840.043236:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130800384:0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.043258:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061840.043295:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130799488 00000100:00100000:0.0:1789061840.043305:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130799488 00000100:00100000:0.0:1789061840.043361:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789061840.043372:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130799488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.043437:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130799488:12345-0@lo:400:kworker.0 Request processed in 66us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061840.043453:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789061840.043481:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130800000 00000100:00100000:0.0:1789061840.043486:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130800000 00000100:00100000:0.0:1789061840.043519:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130800512 00000100:00100000:0.0:1789061840.043522:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130800512 00000100:00100000:0.0:1789061840.043537:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130799360 00000100:00100000:0.0:1789061840.043540:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130799360 00000100:00100000:0.0:1789061840.043564:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130799872 00000100:00100000:0.0:1789061840.043567:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130799872 00000100:00100000:0.0:1789061840.043581:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130800384 00000100:00100000:0.0:1789061840.043584:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130800384 00000100:00100000:0.0:1789061840.043599:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789061840.043641:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130800000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.043677:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130800000:12345-0@lo:400:kworker.0 Request processed in 72us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061840.043683:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789061840.043697:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789061840.043703:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130800512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.043729:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130800512:12345-0@lo:400:kworker.0 Request processed in 26us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061840.043735:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789061840.043745:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789061840.043750:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130799360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044005:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130799232:0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044046:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061840.044079:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130799744:0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044103:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061840.044136:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130800256:0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044176:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061840.044197:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130800768:0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044219:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061840.044240:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789061840.044247:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875967130799616:0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044269:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061840.044279:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130800128:0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044297:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061840.044316:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130800640:0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044337:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061840.044369:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130799232 00000100:00100000:1.0:1789061840.044375:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130799232 00000100:00100000:1.0:1789061840.044411:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789061840.044418:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130799232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044455:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130799232:12345-0@lo:400:kworker.0 Request processed in 38us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061840.044461:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789061840.044492:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130799744 00000100:00100000:1.0:1789061840.044495:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130799744 00000100:00100000:1.0:1789061840.044519:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789061840.044526:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130799744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044564:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130799744:12345-0@lo:400:kworker.0 Request processed in 39us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061840.044570:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789061840.044587:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130800256 00000100:00100000:1.0:1789061840.044590:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130800256 00000100:00100000:1.0:1789061840.044652:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130800768 00000100:00100000:1.0:1789061840.044656:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130800768 00000100:00100000:1.0:1789061840.044668:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130800128 00000100:00100000:1.0:1789061840.044670:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130800128 00000100:00100000:1.0:1789061840.044678:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130800640 00000100:00100000:1.0:1789061840.044681:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130800640 00000100:00100000:1.0:1789061840.044693:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789061840.044698:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130800256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044730:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130800256:12345-0@lo:400:kworker.0 Request processed in 32us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061840.044735:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789061840.044746:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789061840.044751:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130800768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044774:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130800768:12345-0@lo:400:kworker.0 Request processed in 24us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061840.044779:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789061840.044789:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789061840.044794:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130800128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044838:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130800128:12345-0@lo:400:kworker.0 Request processed in 43us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061840.044843:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789061840.044852:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789061840.044857:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130800640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.044879:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130800640:12345-0@lo:400:kworker.0 Request processed in 22us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061840.044884:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789061840.045179:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130799360:12345-0@lo:400:kworker.0 Request processed in 22us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061840.045192:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789061840.045216:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130799616 00000100:00100000:0.0:1789061840.045234:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130799616 00000100:00100000:0.0:1789061840.045263:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789061840.045269:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130799872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.045305:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130799872:12345-0@lo:400:kworker.0 Request processed in 36us (2093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061840.045312:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789061840.045324:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789061840.045331:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130800384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.045358:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130800384:12345-0@lo:400:kworker.0 Request processed in 28us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061840.045364:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789061840.045375:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789061840.045380:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875967130799616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.045404:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875967130799616:12345-0@lo:400:kworker.0 Request processed in 24us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061840.045410:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1789061840.045452:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061840.045458:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789061840.045461:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061840.045463:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789061840.045496:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130799360:0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.045509:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130799872:0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.045520:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130800384:0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.045531:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130799488:0@lo:400:kworker.0 00010000:00080000:0.0:1789061840.045546:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d4a80 x1875967130800000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061840.045577:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130800000:0@lo:400:kworker.0 00010000:00080000:0.0:1789061840.045594:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d4700 x1875967130800512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061840.045602:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130800512:0@lo:400:kworker.0 00010000:00080000:1.0:1789061840.045874:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d7100 x1875967130800128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061840.045893:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130800128:0@lo:400:kworker.0 00010000:00080000:1.0:1789061840.045907:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d5c00 x1875967130800640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061840.045915:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130800640:0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.045925:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130799232:0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.045936:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130799744:0@lo:400:kworker.0 00010000:00080000:1.0:1789061840.045947:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d6a00 x1875967130800256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061840.045955:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130800256:0@lo:400:kworker.0 00010000:00080000:1.0:1789061840.045965:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d7480 x1875967130800768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061840.045973:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130800768:0@lo:400:kworker.0 00000100:00100000:1.0:1789061840.045998:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875967130799616:0@lo:400:kworker.0 00000100:00100000:0.0:1789061840.558468:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130800896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061840.558536:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061840.558645:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130800896 00000100:00100000:0.0:1789061840.558652:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130800896 00000100:00100000:0.0:1789061840.558696:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789061840.558705:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130800896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789061840.558732:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061840.558770:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130800896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061840.558777:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789061840.558814:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d4700 x1875967130800896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061840.558830:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130800896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061840.559340:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061840.559350:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130801024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061840.559382:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061840.559822:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130801024 00000100:00100000:3.0:1789061840.559828:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130801024 00000100:00100000:3.0:1789061840.559864:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789061840.559871:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130801024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061840.559891:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061840.559930:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130801024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061840.559937:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789061840.559966:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd51ed80 x1875967130801024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061840.559996:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130801024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061840.560202:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061840.560212:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130801152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061840.560242:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061840.560308:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130801152 00000100:00100000:2.0:1789061840.560313:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130801152 00000100:00100000:2.0:1789061840.560346:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789061840.560353:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130801152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789061840.560375:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789061840.560418:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130801152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061840.560425:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789061840.560453:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130801152:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789061840.682208:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061841.705887:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061842.729929:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061843.114138:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061843.114159:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130801280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789061843.114228:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061843.125411:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130801280 00000100:00100000:0.0:1789061843.125426:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130801280 00000100:00100000:1.0:1789061843.129960:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789061843.129986:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130801280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789061843.130024:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789061843.130101:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130801280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (15871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061843.130108:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789061843.130409:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130801280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061843.210385:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061843.210418:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061843.210441:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061843.210468:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061843.210498:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061843.210819:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120253184 00000100:00100000:0.0:1789061843.210819:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120252928 00000100:00100000:3.0:1789061843.210829:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120253184 00000100:00100000:0.0:1789061843.210829:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120252928 00000100:00100000:3.0:1789061843.210894:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120253056 00000100:00100000:3.0:1789061843.210898:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120253056 00000100:00100000:1.0:1789061843.211595:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120252672 00000100:00100000:1.0:1789061843.211602:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120252672 00000100:00100000:1.0:1789061843.211653:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 275 00000100:00100000:1.0:1789061843.211674:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:2392:x1875967120252672:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061843.211750:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:2392:x1875967120252672:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 89us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061843.211757:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 275 00000100:00080000:2.0:1789061843.219820:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061843.219830:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789061843.219833:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061843.220900:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:2.0:1789061843.220919:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120253184:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061843.221158:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120253184:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 246us (10714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061843.221166:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:1.0:1789061843.223124:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120252800 00000100:00100000:1.0:1789061843.223138:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120252800 00000100:00100000:1.0:1789061843.223211:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:1.0:1789061843.223220:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120252800:12345-192.168.203.3@tcp:400:kworker.0 00000100:00080000:2.0:1789061843.223275:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061843.223284:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120252800:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 66us (12816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061843.223292:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:0.0:1789061843.223519:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:0.0:1789061843.223549:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120252928:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061843.223578:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120252928:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 32us (13160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061843.223584:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:3.0:1789061843.225572:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:3.0:1789061843.225585:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120253056:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061843.226029:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120253056:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 445us (15529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061843.226037:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000001:02000400:1.0:1789061843.388588:0:10672:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1789061843.625930:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061843.625964:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130801408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061843.626194:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061843.626370:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130801408 00000100:00100000:0.0:1789061843.626379:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130801408 00000100:00100000:0.0:1789061843.626447:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789061843.626455:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130801408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061843.626485:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061843.626545:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130801408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061843.626552:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789061843.626589:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d4700 x1875967130801408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061843.626626:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130801408:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789061843.626684:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061843.626885:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130801536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061843.626919:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061843.627179:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130801536 00000100:00100000:0.0:1789061843.627184:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130801536 00000100:00100000:0.0:1789061843.627222:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789061843.627229:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130801536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789061843.627239:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061843.627270:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130801536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061843.627276:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789061843.627300:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d4700 x1875967130801536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061843.627327:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130801536:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789061843.627369:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789061843.754927:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061844.777950:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061845.161898:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130801920:0@lo:400:kworker.0 00000100:00100000:0.0:1789061845.162012:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061845.162080:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130802432:0@lo:400:kworker.0 00000100:00100000:0.0:1789061845.162111:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061845.162131:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130802944:0@lo:400:kworker.0 00000100:00100000:0.0:1789061845.162153:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061845.162179:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789061845.162186:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130802048:0@lo:400:kworker.0 00000100:00100000:0.0:1789061845.162208:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061845.162231:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130802560:0@lo:400:kworker.0 00000100:00100000:0.0:1789061845.162256:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061845.162272:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130803072:0@lo:400:kworker.0 00000100:00100000:0.0:1789061845.162296:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061845.162338:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130801920 00000100:00100000:0.0:1789061845.162348:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130801920 00000100:00100000:0.0:1789061845.162409:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789061845.162420:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130801920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.162488:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130801792:0@lo:400:kworker.0 00000100:00100000:0.0:1789061845.162491:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130801920:12345-0@lo:400:kworker.0 Request processed in 70us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061845.162504:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789061845.162545:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130802432 00000100:00100000:0.0:1789061845.162549:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130802432 00000100:00100000:2.0:1789061845.162555:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061845.162582:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130802304:0@lo:400:kworker.0 00000100:00100000:0.0:1789061845.162594:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130802944 00000100:00100000:0.0:1789061845.162629:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130802944 00000100:00100000:2.0:1789061845.162630:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061845.162649:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130802816:0@lo:400:kworker.0 00000100:00100000:0.0:1789061845.162656:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130802048 00000100:00100000:0.0:1789061845.162661:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130802048 00000100:00100000:0.0:1789061845.162679:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130801792 00000100:00100000:2.0:1789061845.162683:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061845.162684:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130801792 00000100:00100000:0.0:1789061845.162701:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130802304 00000100:00100000:0.0:1789061845.162704:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130802304 00000100:00100000:2.0:1789061845.162706:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789061845.162718:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130802816 00000100:00100000:2.0:1789061845.162722:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130801664:0@lo:400:kworker.0 00000100:00100000:0.0:1789061845.162723:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130802816 00000100:00100000:0.0:1789061845.162745:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789061845.162755:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130802432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.162761:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061845.162854:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789061845.162865:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130802944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.164624:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130802176:0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.164704:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061845.164741:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130802688:0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.164767:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061845.164795:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130803200:0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.164824:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061845.164879:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130802560 00000100:00100000:2.0:1789061845.164889:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130802560 00000100:00100000:2.0:1789061845.164937:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130803072 00000100:00100000:2.0:1789061845.164940:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130803072 00000100:00100000:2.0:1789061845.164955:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130802688 00000100:00100000:2.0:1789061845.164957:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130802688 00000100:00100000:2.0:1789061845.164970:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130803200 00000100:00100000:2.0:1789061845.164973:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130803200 00000100:00100000:2.0:1789061845.164991:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789061845.165000:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130802560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.165053:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130802560:12345-0@lo:400:kworker.0 Request processed in 55us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061845.165061:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789061845.165080:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789061845.165086:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd8e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130803072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.165115:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd8e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130803072:12345-0@lo:400:kworker.0 Request processed in 30us (2818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061845.165122:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789061845.165305:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789061845.165311:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130802688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.165349:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130802688:12345-0@lo:400:kworker.0 Request processed in 38us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061845.165366:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789061845.165379:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789061845.165385:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130803200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.165430:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130803200:12345-0@lo:400:kworker.0 Request processed in 46us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061845.165436:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789061845.165480:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130802176 00000100:00100000:2.0:1789061845.165485:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130802176 00000100:00100000:2.0:1789061845.165527:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789061845.165534:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130802176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.165567:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130802176:12345-0@lo:400:kworker.0 Request processed in 34us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061845.165572:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789061845.165641:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130802176:0@lo:400:kworker.0 00010000:00080000:2.0:1789061845.165658:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d4e00 x1875967130802688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061845.165669:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130802688:0@lo:400:kworker.0 00010000:00080000:2.0:1789061845.165679:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b7b80 x1875967130803200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061845.165688:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130803200:0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.165786:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789061845.165796:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130802048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.165830:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130802048:12345-0@lo:400:kworker.0 Request processed in 37us (3621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061845.165843:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789061845.165859:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789061845.165865:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130801792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.165903:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130801792:12345-0@lo:400:kworker.0 Request processed in 38us (3351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061845.165908:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789061845.165921:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789061845.165929:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130802304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.165957:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130802304:12345-0@lo:400:kworker.0 Request processed in 30us (3328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061845.165962:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789061845.165973:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789061845.165979:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130802816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.166007:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130802816:12345-0@lo:400:kworker.0 Request processed in 27us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061845.166012:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1789061845.166031:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061845.166037:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061845.166040:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789061845.166043:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789061845.166076:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130802048:0@lo:400:kworker.0 00010000:00080000:2.0:1789061845.166091:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d6a00 x1875967130802560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061845.166101:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130802560:0@lo:400:kworker.0 00010000:00080000:2.0:1789061845.166128:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b7800 x1875967130803072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061845.166138:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130803072:0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.166151:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130801920:0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.166186:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130801792:0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.166197:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130802304:0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.166209:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130802816:0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.166245:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130801664 00000100:00100000:2.0:1789061845.166250:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130801664 00000100:00100000:2.0:1789061845.166289:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789061845.166296:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130801664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.166335:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130801664:12345-0@lo:400:kworker.0 Request processed in 40us (3574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061845.166341:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789061845.166377:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130801664:0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.176862:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130802944:12345-0@lo:400:kworker.0 Request processed in 13983us (14691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061845.176884:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1789061845.176971:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d7100 x1875967130802944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061845.176989:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130802944:0@lo:400:kworker.0 00000100:00100000:0.0:1789061845.180535:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130802432:12345-0@lo:400:kworker.0 Request processed in 17760us (18401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061845.180554:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1789061845.180825:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d7480 x1875967130802432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061845.180860:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130802432:0@lo:400:kworker.0 00000100:00100000:2.0:1789061845.673885:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130803328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789061845.673957:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061845.674074:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130803328 00000100:00100000:0.0:1789061845.674082:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130803328 00000100:00100000:0.0:1789061845.674138:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789061845.674148:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130803328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789061845.674177:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061845.674220:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130803328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061845.674226:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789061845.674310:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6728e00 x1875967130803328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061845.674328:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130803328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061845.675775:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130803456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061845.675824:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061845.675861:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061845.675867:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130803584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061845.675889:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061845.675970:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130803456 00000100:00100000:2.0:1789061845.675978:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130803456 00000100:00100000:2.0:1789061845.676026:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789061845.676034:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130803456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789061845.676062:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789061845.676105:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130803456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061845.676112:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789061845.676150:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130803456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061845.676209:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130803584 00000100:00100000:3.0:1789061845.676214:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130803584 00000100:00100000:3.0:1789061845.676246:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789061845.676253:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130803584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061845.676267:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061845.676300:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130803584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061845.676322:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789061845.676393:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7504e00 x1875967130803584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061845.676407:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130803584:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789061845.805005:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061846.833052:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061847.849814:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061848.234682:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061848.234705:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130803712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061848.234773:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061848.237543:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130803712 00000100:00100000:0.0:1789061848.237557:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130803712 00000100:00100000:0.0:1789061848.237657:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789061848.237667:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130803712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789061848.237703:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789061848.245284:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130803712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7611us (10502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061848.245298:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789061848.245444:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130803712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789061848.336941:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061848.336979:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061848.337004:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061848.337033:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120253312 00000100:00100000:0.0:1789061848.337043:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120253312 00000100:00100000:0.0:1789061848.337091:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 277 00000100:00100000:0.0:1789061848.337100:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+10:2391:x1875967120253312:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061848.337236:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+10:2391:x1875967120253312:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 136us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061848.337243:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 277 00000100:00100000:0.0:1789061848.337275:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120253568 00000100:00100000:0.0:1789061848.337279:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120253568 00000100:00100000:0.0:1789061848.337309:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120253440 00000100:00100000:0.0:1789061848.337312:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120253440 00000100:00100000:0.0:1789061848.337331:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:0.0:1789061848.337337:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120253568:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061848.337364:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120253568:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061848.337370:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:0.0:1789061848.337381:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:0.0:1789061848.337386:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120253440:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061848.337416:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120253440:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061848.337422:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00080000:0.0:1789061848.337443:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061848.337446:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789061848.349532:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061848.349576:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061848.350237:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120253696 00000100:00100000:3.0:1789061848.350258:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120253696 00000100:00100000:3.0:1789061848.350324:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120253824 00000100:00100000:3.0:1789061848.350328:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120253824 00000100:00100000:3.0:1789061848.350348:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:3.0:1789061848.350356:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2389:x1875967120253696:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:3.0:1789061848.350390:0:8413:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc675f 00000100:00080000:3.0:1789061848.350400:0:8413:0:(import.c:65:import_set_state_nolock()) ffff9766c754c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789061848.350438:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789061848.350601:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+2:2389:x1875967120253696:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 244us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061848.350633:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:3.0:1789061848.350649:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:3.0:1789061848.350656:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2389:x1875967120253824:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:3.0:1789061848.350668:0:8413:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6758 00000100:00080000:3.0:1789061848.350674:0:8413:0:(import.c:65:import_set_state_nolock()) ffff9767fd824000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789061848.350699:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789061848.350762:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+2:2389:x1875967120253824:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 106us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061848.350770:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00010000:00010000:3.0:1789061848.350787:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061848.351217:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789061848.351224:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061848.351227:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789061848.654131:0:10916:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing yml_node 00000100:00100000:2.0:1789061848.748015:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061848.748034:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130803840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061848.748095:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061848.748158:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130803840 00000100:00100000:2.0:1789061848.748166:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130803840 00000100:00100000:2.0:1789061848.748215:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789061848.748225:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130803840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061848.748251:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061848.748291:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130803840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061848.748298:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789061848.748320:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061848.748347:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7506d80 x1875967130803840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061848.748364:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130803840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061848.748693:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130803968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789061848.748724:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061848.749799:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130803968 00000100:00100000:2.0:1789061848.749808:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130803968 00000100:00100000:2.0:1789061848.749869:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789061848.749878:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130803968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789061848.749895:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789061848.752547:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061848.759942:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130803968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10057us (11208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061848.759963:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789061848.765657:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c672a300 x1875967130803968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061848.765685:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130803968:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789061848.878566:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061849.897973:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061850.284977:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130804352:0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.285060:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061850.285129:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130804864:0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.285153:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061850.285169:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130805376:0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.285209:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061850.285240:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789061850.285246:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130804224:0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.285267:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061850.285278:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130804480:0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.285280:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130804736:0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.285297:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061850.285317:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061850.285322:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130805248:0@lo:400:kworker.0 00000100:00100000:2.0:1789061850.285350:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130804992:0@lo:400:kworker.0 00000100:00100000:0.0:1789061850.285851:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130804096:0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.285939:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061850.285987:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130804864 00000100:00100000:3.0:1789061850.285995:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130804864 00000100:00100000:3.0:1789061850.286052:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130805376 00000100:00100000:3.0:1789061850.286055:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130805376 00000100:00100000:3.0:1789061850.286081:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130804224 00000100:00100000:3.0:1789061850.286084:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130804224 00000100:00100000:3.0:1789061850.286096:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130804736 00000100:00100000:3.0:1789061850.286098:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130804736 00000100:00100000:3.0:1789061850.286110:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130804480 00000100:00100000:3.0:1789061850.286112:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130804480 00000100:00100000:3.0:1789061850.286132:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130805248 00000100:00100000:3.0:1789061850.286135:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130805248 00000100:00100000:3.0:1789061850.286150:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789061850.286158:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130804864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.286210:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130804864:12345-0@lo:400:kworker.0 Request processed in 52us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061850.286216:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789061850.286232:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789061850.286238:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130805376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.286264:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130805376:12345-0@lo:400:kworker.0 Request processed in 27us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061850.286270:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789061850.286282:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789061850.286287:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130804224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.286312:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130804224:12345-0@lo:400:kworker.0 Request processed in 25us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061850.286318:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789061850.286328:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789061850.286345:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130804736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.286371:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130804736:12345-0@lo:400:kworker.0 Request processed in 28us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061850.286376:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789061850.286387:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789061850.286392:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130804480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.286418:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130804480:12345-0@lo:400:kworker.0 Request processed in 26us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061850.286429:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789061850.286440:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789061850.286445:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130805248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.286474:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130805248:12345-0@lo:400:kworker.0 Request processed in 29us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061850.286489:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789061850.286507:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130804352 00000100:00100000:3.0:1789061850.286511:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130804352 00000100:00100000:3.0:1789061850.286538:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789061850.286544:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130804352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.286573:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130804352:12345-0@lo:400:kworker.0 Request processed in 30us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061850.286578:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789061850.286630:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130804224:0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.286641:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130804736:0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.286650:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130805248:0@lo:400:kworker.0 00000100:00100000:3.0:1789061850.286659:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130804352:0@lo:400:kworker.0 00010000:00080000:3.0:1789061850.286669:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fb0af480 x1875967130804864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061850.286679:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130804864:0@lo:400:kworker.0 00010000:00080000:3.0:1789061850.286687:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676b480 x1875967130805376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061850.286695:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130805376:0@lo:400:kworker.0 00000100:00080000:1.0:1789061850.288194:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061850.288203:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061850.288252:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061850.288293:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130805504:0@lo:400:kworker.0 00000100:00100000:1.0:1789061850.288318:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061850.288387:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130804480:0@lo:400:kworker.0 00000100:00100000:2.0:1789061850.288463:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130804992 00000100:00100000:2.0:1789061850.288470:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130804992 00000100:00100000:2.0:1789061850.288529:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130805504 00000100:00100000:2.0:1789061850.288533:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130805504 00000100:00100000:2.0:1789061850.288552:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789061850.288561:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130804992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061850.288620:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130804992:12345-0@lo:400:kworker.0 Request processed in 45us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061850.288627:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789061850.288642:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789061850.288647:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130805504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061850.288674:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130805504:12345-0@lo:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061850.288679:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789061850.288848:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061850.288852:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061850.288871:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fb0ace00 x1875967130804992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061850.288882:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130804992:0@lo:400:kworker.0 00010000:00080000:1.0:1789061850.288893:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6769880 x1875967130805504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061850.288901:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130805504:0@lo:400:kworker.0 00000100:00100000:0.0:1789061850.290381:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061850.290433:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130804608:0@lo:400:kworker.0 00000100:00100000:0.0:1789061850.290463:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061850.290498:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130805120:0@lo:400:kworker.0 00000100:00100000:0.0:1789061850.290519:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061850.290546:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130805632:0@lo:400:kworker.0 00000100:00100000:0.0:1789061850.290563:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061850.290618:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130805120 00000100:00100000:0.0:1789061850.290624:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130805120 00000100:00100000:0.0:1789061850.290668:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130805632 00000100:00100000:0.0:1789061850.290671:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130805632 00000100:00100000:0.0:1789061850.290693:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789061850.290701:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130805120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061850.290752:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130805120:12345-0@lo:400:kworker.0 Request processed in 52us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061850.290768:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789061850.290782:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789061850.290788:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130805632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061850.290811:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130805632:12345-0@lo:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061850.290828:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789061850.290866:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676aa00 x1875967130805120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061850.290878:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130805120:0@lo:400:kworker.0 00010000:00080000:0.0:1789061850.290888:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6768e00 x1875967130805632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061850.290895:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130805632:0@lo:400:kworker.0 00000100:00100000:1.0:1789061850.291203:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130804608 00000100:00100000:1.0:1789061850.291209:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130804608 00000100:00100000:1.0:1789061850.291246:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789061850.291252:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130804608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061850.291290:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130804608:12345-0@lo:400:kworker.0 Request processed in 38us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061850.291305:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1789061850.291322:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061850.291325:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061850.291438:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130804608:0@lo:400:kworker.0 00000100:00100000:2.0:1789061850.291633:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130804096 00000100:00100000:2.0:1789061850.291637:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130804096 00000100:00100000:2.0:1789061850.291709:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789061850.291725:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130804096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061850.291775:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130804096:12345-0@lo:400:kworker.0 Request processed in 51us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061850.291780:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789061850.291848:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130804096:0@lo:400:kworker.0 00000100:00100000:1.0:1789061850.794811:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130805760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061850.794881:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061850.794959:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061850.794964:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130805888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061850.794987:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061850.795188:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130805760 00000100:00100000:2.0:1789061850.795196:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130805760 00000100:00100000:2.0:1789061850.795232:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130805888 00000100:00100000:2.0:1789061850.795236:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130805888 00000100:00100000:2.0:1789061850.795250:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789061850.795257:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130805760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061850.795283:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061850.795333:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130805760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061850.795341:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789061850.795365:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789061850.795371:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130805888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789061850.795380:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061850.795402:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130805888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061850.795408:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789061850.796333:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c672b800 x1875967130805888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061850.796362:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130805888:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789061850.796375:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7507b80 x1875967130805760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061850.796384:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130805760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061850.796409:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061850.796416:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130806016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061850.796455:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061850.796540:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130806016 00000100:00100000:3.0:1789061850.796546:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130806016 00000100:00100000:3.0:1789061850.796586:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789061850.796594:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130806016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789061850.796631:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789061850.796673:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130806016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061850.796679:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789061850.796708:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130806016:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789061850.921885:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061851.945872:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789061852.328347:0:11099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:3.0:1789061852.975827:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061853.354751:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061853.354781:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130806144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061853.354886:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061853.354978:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130806144 00000100:00100000:2.0:1789061853.354999:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130806144 00000100:00100000:2.0:1789061853.355066:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789061853.355077:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130806144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789061853.355125:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789061853.355180:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130806144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061853.355203:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789061853.355260:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130806144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061853.448120:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061853.448174:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061853.448214:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061853.448280:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120254208 00000100:00100000:3.0:1789061853.448292:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120254208 00000100:00100000:3.0:1789061853.448375:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120254080 00000100:00100000:3.0:1789061853.448379:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120254080 00000100:00100000:3.0:1789061853.448409:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:3.0:1789061853.448422:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120254208:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061853.448528:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120254208:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061853.448536:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:3.0:1789061853.448556:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00100000:3.0:1789061853.448563:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120254080:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061853.448590:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120254080:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061853.448596:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00080000:2.0:1789061853.448823:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789061853.448835:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061853.449369:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120253952 00000100:00100000:1.0:1789061853.449377:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120253952 00000100:00100000:1.0:1789061853.449431:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 279 00000100:00100000:1.0:1789061853.449440:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:2393:x1875967120253952:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061853.449503:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:2393:x1875967120253952:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 64us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061853.449525:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 279 00000100:00100000:1.0:1789061853.866088:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130806272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061853.866188:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061853.866287:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130806272 00000100:00100000:1.0:1789061853.866296:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130806272 00000100:00100000:1.0:1789061853.866367:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789061853.866379:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130806272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061853.866419:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061853.866478:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130806272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061853.866486:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1789061853.866514:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061853.866551:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7507480 x1875967130806272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061853.866572:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130806272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061853.867682:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130806400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789061853.867756:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061853.867982:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130806400 00000100:00100000:2.0:1789061853.867989:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130806400 00000100:00100000:2.0:1789061853.868043:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789061853.868053:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130806400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789061853.868072:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061853.868119:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130806400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061853.868126:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1789061853.868163:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7507480 x1875967130806400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061853.868181:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130806400:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789061853.868658:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789061853.873757:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000020:00000080:1.0:1789061853.873771:0:8406:0:(genops.c:885:class_export_put()) final put ffff9766c754b800/8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000020:00000080:2.0:1789061853.873913:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c754b800/8b387fcf-29cb-4ebc-866a-7eab61aa3868 for lustre-OST0000 00000020:00000080:2.0:1789061853.873979:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c754c000 for lustre-OST0000 00000001:00100000:1.0:1789061853.874107:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000020:00000080:1.0:1789061853.874112:0:9490:0:(genops.c:885:class_export_put()) final put ffff9767fd822000/8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000020:00000080:3.0:1789061853.874160:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd822000/8b387fcf-29cb-4ebc-866a-7eab61aa3868 for lustre-OST0001 00000020:00000080:3.0:1789061853.874206:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fd824000 for lustre-OST0001 00010000:00010000:2.0:1789061853.995049:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061855.028688:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789061855.270787:0:11197:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:0.0:1789061855.402266:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130806784:0@lo:400:kworker.0 00000100:00100000:0.0:1789061855.402374:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061855.402435:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130807296:0@lo:400:kworker.0 00000100:00100000:0.0:1789061855.402475:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061855.402493:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130807808:0@lo:400:kworker.0 00000100:00100000:0.0:1789061855.402513:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061855.402537:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789061855.402542:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130806912:0@lo:400:kworker.0 00000100:00100000:0.0:1789061855.402558:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061855.402571:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130807424:0@lo:400:kworker.0 00000100:00100000:0.0:1789061855.402593:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061855.402646:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130807936:0@lo:400:kworker.0 00000100:00100000:0.0:1789061855.402666:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061855.402707:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130807424 00000100:00100000:0.0:1789061855.402716:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130807424 00000100:00100000:0.0:1789061855.402786:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130807936 00000100:00100000:0.0:1789061855.402790:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130807936 00000100:00100000:1.0:1789061855.402977:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130806528:0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403015:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061855.403040:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130807040:0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403061:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061855.403079:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130807552:0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403108:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061855.403118:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130808064:0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403136:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061855.403149:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789061855.403155:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130806656:0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403175:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061855.403192:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130807168:0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403210:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061855.403225:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130807680:0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403244:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061855.403268:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130806784 00000100:00100000:1.0:1789061855.403272:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130806784 00000100:00100000:1.0:1789061855.403303:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130807040 00000100:00100000:1.0:1789061855.403305:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130807040 00000100:00100000:1.0:1789061855.403320:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789061855.403342:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130806784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403410:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130806784:12345-0@lo:400:kworker.0 Request processed in 81us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061855.403417:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789061855.403437:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789061855.403454:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130807040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403488:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130807040:12345-0@lo:400:kworker.0 Request processed in 34us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061855.403494:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789061855.403514:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130806528 00000100:00100000:1.0:1789061855.403518:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130806528 00000100:00100000:1.0:1789061855.403552:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789061855.403559:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130806528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403587:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130806528:12345-0@lo:400:kworker.0 Request processed in 30us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061855.403593:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789061855.403673:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130806528:0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403687:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130807040:0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403720:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130806784:0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.403759:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130807552 00000100:00100000:1.0:1789061855.403763:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130807552 00000100:00100000:0.0:1789061855.404943:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789061855.404969:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130807424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061855.405056:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130807424:12345-0@lo:400:kworker.0 Request processed in 98us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061855.405211:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130807296 00000100:00100000:2.0:1789061855.405219:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130807296 00000100:00100000:2.0:1789061855.405260:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130807808 00000100:00100000:2.0:1789061855.405264:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130807808 00000100:00100000:2.0:1789061855.405297:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130806912 00000100:00100000:2.0:1789061855.405301:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130806912 00000100:00100000:2.0:1789061855.405310:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130806656 00000100:00100000:2.0:1789061855.405313:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130806656 00000100:00100000:2.0:1789061855.405322:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130807168 00000100:00100000:2.0:1789061855.405325:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130807168 00000100:00100000:3.0:1789061855.405451:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130807680 00000100:00100000:3.0:1789061855.405456:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130807680 00000100:00100000:3.0:1789061855.405482:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789061855.405489:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130807296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061855.405531:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130807296:12345-0@lo:400:kworker.0 Request processed in 43us (3055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061855.405537:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789061855.405554:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789061855.405559:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130807808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061855.405589:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130807808:12345-0@lo:400:kworker.0 Request processed in 30us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061855.405595:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789061855.405620:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789061855.405627:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130806912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061855.405657:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130806912:12345-0@lo:400:kworker.0 Request processed in 31us (3097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061855.405663:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789061855.405675:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789061855.405681:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130806656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061855.405719:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130806656:12345-0@lo:400:kworker.0 Request processed in 38us (2542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061855.405736:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789061855.405750:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789061855.405755:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130807680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061855.405784:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130807680:12345-0@lo:400:kworker.0 Request processed in 29us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061855.405790:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1789061855.405828:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061855.405834:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789061855.405837:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061855.405840:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061855.405851:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130808064 00000100:00100000:3.0:1789061855.405854:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130808064 00000100:00100000:2.0:1789061855.405939:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789061855.405946:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130807168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061855.405983:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130807168:12345-0@lo:400:kworker.0 Request processed in 38us (2772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061855.405989:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789061855.407504:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789061855.407527:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130807936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.407617:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130807936:12345-0@lo:400:kworker.0 Request processed in 90us (4936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061855.407624:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789061855.407643:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789061855.407650:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130807552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061855.407680:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130807552:12345-0@lo:400:kworker.0 Request processed in 31us (4570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061855.407686:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789061855.407946:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789061855.408012:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130806912:0@lo:400:kworker.0 00010000:00080000:0.0:1789061855.408032:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c3b80 x1875967130807424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061855.408044:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130807424:0@lo:400:kworker.0 00010000:00080000:0.0:1789061855.408057:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c1180 x1875967130807936/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061855.408064:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130807936:0@lo:400:kworker.0 00010000:00080000:0.0:1789061855.408076:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6729880 x1875967130807296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061855.408085:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130807296:0@lo:400:kworker.0 00010000:00080000:0.0:1789061855.408097:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c2d80 x1875967130807808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061855.408105:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130807808:0@lo:400:kworker.0 00000100:00100000:2.0:1789061855.408699:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130806656:0@lo:400:kworker.0 00000100:00100000:2.0:1789061855.408716:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130807168:0@lo:400:kworker.0 00000100:00100000:2.0:1789061855.408729:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130807680:0@lo:400:kworker.0 00010000:00080000:2.0:1789061855.408742:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c0380 x1875967130807552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061855.408752:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130807552:0@lo:400:kworker.0 00000100:00100000:3.0:1789061855.412005:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789061855.412030:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130808064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061855.412160:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130808064:12345-0@lo:400:kworker.0 Request processed in 142us (9022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061855.412168:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789061855.412209:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061855.412217:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789061855.413538:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c1500 x1875967130808064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061855.413560:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130808064:0@lo:400:kworker.0 00000100:00100000:2.0:1789061855.914018:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130808320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061855.914116:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061855.914207:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061855.914217:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130808192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789061855.914250:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061855.914301:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130808192 00000100:00100000:1.0:1789061855.914302:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130808320 00000100:00100000:2.0:1789061855.914311:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130808192 00000100:00100000:1.0:1789061855.914311:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130808320 00000100:00100000:2.0:1789061855.914368:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789061855.914368:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789061855.914379:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130808192:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061855.914379:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130808320:12345-0@lo:13:osp-pre-1-0.0 00000004:00000024:2.0:1789061855.914417:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00002000:00000024:1.0:1789061855.914418:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061855.914946:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130808448:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789061855.915943:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7507480 x1875967130808320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061855.915972:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130808320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061855.917775:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130808192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061855.919843:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130808320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5451us (5713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061855.919862:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789061855.919932:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061855.919973:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130808192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5591us (5717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061855.919986:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789061855.920070:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130808448 00000100:00100000:1.0:1789061855.920081:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130808448 00000100:00100000:1.0:1789061855.920130:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789061855.920139:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130808448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789061855.920170:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061855.920247:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130808448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061855.920254:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789061855.920294:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd5c6300 x1875967130808448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061855.920318:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130808448:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789061856.042634:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061857.068487:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789061857.772582:0:11294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:2.0:1789061858.090025:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061858.475133:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130808576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061858.475219:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061858.475407:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130808576 00000100:00100000:0.0:1789061858.475431:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130808576 00000100:00100000:0.0:1789061858.475482:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789061858.475492:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130808576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789061858.475526:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789061858.475582:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130808576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061858.475589:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789061858.475657:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130808576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061858.564652:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061858.564691:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061858.564714:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061858.564742:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120254592 00000100:00100000:3.0:1789061858.564751:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120254592 00000100:00100000:3.0:1789061858.564907:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120254464 00000100:00100000:3.0:1789061858.564911:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120254464 00000100:00100000:0.0:1789061858.564969:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120254336 00000100:00100000:0.0:1789061858.564973:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120254336 00000100:00100000:0.0:1789061858.565003:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 281 00000100:00100000:0.0:1789061858.565012:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+10:2390:x1875967120254336:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061858.565078:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+10:2390:x1875967120254336:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 66us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061858.565085:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 281 00000100:00100000:1.0:1789061858.567746:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 97 00000100:00100000:1.0:1789061858.567764:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120254592:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061858.567844:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120254592:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 85us (3151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061858.567852:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 97 00000100:00100000:1.0:1789061858.567876:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 98 00000100:00100000:1.0:1789061858.567883:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2390:x1875967120254464:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061858.567905:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2390:x1875967120254464:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (3190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061858.567911:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 98 00000100:00080000:3.0:1789061858.569744:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061858.569753:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789061858.985833:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061858.985855:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130808704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061858.985921:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061858.985983:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130808704 00000100:00100000:2.0:1789061858.985990:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130808704 00000100:00100000:2.0:1789061858.986040:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789061858.986050:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130808704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789061858.986087:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061858.986128:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130808704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061858.986135:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789061858.986174:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d7100 x1875967130808704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061858.986192:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130808704:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789061858.986668:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061858.986889:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061858.986899:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130808832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061858.986931:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061858.986967:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130808832 00000100:00100000:2.0:1789061858.986972:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130808832 00000100:00100000:2.0:1789061858.987000:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789061858.987007:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130808832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061858.987020:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061858.987049:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130808832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061858.987067:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789061858.987082:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061858.987100:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d7100 x1875967130808832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061858.987113:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130808832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789061859.115781:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789061859.135483:0:11342:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 10 13:37:36 EDT 2026 00010000:00010000:3.0:1789061860.141712:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061860.527421:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130808960:0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.527534:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061860.527759:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130808960 00000100:00100000:3.0:1789061860.527770:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130808960 00000100:00100000:3.0:1789061860.527842:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789061860.527853:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130808960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061860.531665:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130809088:0@lo:400:kworker.0 00000100:00100000:1.0:1789061860.531774:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061860.531974:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130809472:0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.532012:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061860.532056:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130809984:0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.532096:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061860.532128:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130810496:0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.532151:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061860.532254:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130809600:0@lo:400:kworker.0 00000100:00100000:1.0:1789061860.532279:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061860.534924:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130808960:12345-0@lo:400:kworker.0 Request processed in 7059us (7376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061860.534942:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789061860.535039:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130809344:0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.535291:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130809472 00000100:00100000:3.0:1789061860.535302:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130809472 00000100:00100000:3.0:1789061860.535366:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789061860.535376:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130809472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.535450:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130809472:12345-0@lo:400:kworker.0 Request processed in 75us (3436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061860.535456:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789061860.535656:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130808960:0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.535696:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130809472:0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.535849:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130809984 00000100:00100000:2.0:1789061860.535872:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130809984 00000100:00100000:2.0:1789061860.535917:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130810496 00000100:00100000:2.0:1789061860.535920:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130810496 00000100:00100000:2.0:1789061860.535945:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789061860.535952:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130809984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.535996:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130809984:12345-0@lo:400:kworker.0 Request processed in 45us (3900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061860.536002:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789061860.536015:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789061860.536021:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130810496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.536050:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130810496:12345-0@lo:400:kworker.0 Request processed in 29us (3898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061860.536055:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789061860.536266:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd514380 x1875967130809984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061860.536279:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130809984:0@lo:400:kworker.0 00010000:00080000:2.0:1789061860.536293:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd515f80 x1875967130810496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061860.536302:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130810496:0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.536568:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130809216:0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.536630:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061860.536658:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130809728:0@lo:400:kworker.0 00000100:00080000:3.0:1789061860.536775:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061860.536781:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061860.536819:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130809216 00000100:00100000:3.0:1789061860.536824:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130809216 00000100:00100000:3.0:1789061860.536855:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789061860.536862:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130809216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.536907:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130809216:12345-0@lo:400:kworker.0 Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061860.536913:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789061860.537515:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130810112:0@lo:400:kworker.0 00000100:00100000:1.0:1789061860.537568:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061860.538023:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130809088 00000100:00100000:0.0:1789061860.538031:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130809088 00000100:00100000:3.0:1789061860.538226:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130809600 00000100:00100000:3.0:1789061860.538231:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130809600 00000100:00100000:3.0:1789061860.538322:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789061860.538331:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130809088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.538386:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130809088:12345-0@lo:400:kworker.0 Request processed in 57us (6613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061860.538394:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789061860.538423:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789061860.538429:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130809600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.538457:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130809600:12345-0@lo:400:kworker.0 Request processed in 29us (6177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061860.538474:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789061860.538728:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130809088:0@lo:400:kworker.0 00000100:00100000:1.0:1789061860.538741:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130809600:0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.539652:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130810112 00000100:00100000:3.0:1789061860.539662:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130810112 00000100:00080000:2.0:1789061860.539729:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061860.541338:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789061860.541351:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130810112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.541478:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130810112:12345-0@lo:400:kworker.0 Request processed in 130us (3909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061860.541487:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789061860.541557:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130810112:0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.541626:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061860.541665:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130810240:0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.541701:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061860.541735:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130809216:0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.541761:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130809728 00000100:00100000:3.0:1789061860.541767:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130809728 00000100:00100000:1.0:1789061860.541831:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130810240 00000100:00100000:1.0:1789061860.541836:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130810240 00000100:00080000:2.0:1789061860.546740:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789061860.548203:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789061860.548227:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130809728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.548371:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130809728:12345-0@lo:400:kworker.0 Request processed in 154us (6764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061860.548380:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789061860.548439:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061860.548553:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130809856:0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.548600:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061860.548641:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130810368:0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.548663:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061860.548705:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130809344 00000100:00100000:3.0:1789061860.548716:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130809344 00000100:00100000:3.0:1789061860.548750:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789061860.548756:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130809344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.548938:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130809856 00000100:00100000:2.0:1789061860.548952:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130809856 00000100:00100000:2.0:1789061860.548988:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130810368 00000100:00100000:2.0:1789061860.548991:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130810368 00000100:00100000:2.0:1789061860.549018:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789061860.549026:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130809856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.549062:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130809856:12345-0@lo:400:kworker.0 Request processed in 37us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061860.549069:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789061860.549195:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789061860.549201:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130810368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061860.549232:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130810368:12345-0@lo:400:kworker.0 Request processed in 31us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061860.549238:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789061860.549282:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061860.549286:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061860.550005:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130809344:12345-0@lo:400:kworker.0 Request processed in 38us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061860.550020:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1789061860.550093:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c672a300 x1875967130809728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061860.550639:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130809728:0@lo:400:kworker.0 00000100:00100000:3.0:1789061860.550695:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130809344:0@lo:400:kworker.0 00010000:00080000:3.0:1789061860.550709:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6728000 x1875967130809856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061860.550718:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130809856:0@lo:400:kworker.0 00010000:00080000:3.0:1789061860.550729:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd515180 x1875967130810368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061860.550737:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130810368:0@lo:400:kworker.0 00000100:00100000:1.0:1789061860.551681:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789061860.551695:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130810240:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789061860.552781:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd517100 x1875967130810240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061860.552946:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130810240:12345-0@lo:400:kworker.0 Request processed in 1255us (11243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061860.552959:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789061860.553050:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130810240:0@lo:400:kworker.0 00000100:00100000:0.0:1789061861.034757:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061861.034786:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130810624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061861.034881:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061861.034970:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130810752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061861.035004:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130810880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061861.035005:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061861.035045:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061861.035069:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130810624 00000100:00100000:0.0:1789061861.035079:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130810624 00000100:00100000:0.0:1789061861.035141:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130810880 00000100:00100000:0.0:1789061861.035145:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130810880 00000100:00100000:0.0:1789061861.035166:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789061861.035175:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130810624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061861.035212:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061861.036841:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130810752 00000100:00100000:1.0:1789061861.037132:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130810752 00000100:00100000:1.0:1789061861.037205:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789061861.037216:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130810752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789061861.037259:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789061861.043572:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130810624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8383us (8676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061861.043593:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789061861.043669:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789061861.043686:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130810880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789061861.043723:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1789061861.044093:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c1180 x1875967130810624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061861.044441:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130810880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 761us (9395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061861.044450:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789061861.044590:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130810624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061861.046685:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130810752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9456us (11665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061861.046936:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1789061861.047034:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7753480 x1875967130810880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061861.047505:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130810880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061861.050246:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130810752:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789061861.162407:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061862.186038:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061863.211563:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061863.594145:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061863.594176:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130811008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061863.594265:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061863.594745:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130811008 00000100:00100000:0.0:1789061863.594756:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130811008 00000100:00100000:0.0:1789061863.596262:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789061863.596296:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130811008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789061863.596347:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789061863.596527:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130811008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 243us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061863.598344:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130811008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789061863.598571:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789061863.689189:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061863.689245:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061863.689287:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061863.689324:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120254848 00000100:00100000:0.0:1789061863.689361:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120254848 00000100:00100000:2.0:1789061863.689440:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120254976 00000100:00100000:2.0:1789061863.689446:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120254976 00000100:00100000:0.0:1789061863.689452:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:0.0:1789061863.689465:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120254848:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061863.689486:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 106 00000100:00100000:2.0:1789061863.689497:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120254976:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061863.689593:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120254720 00000100:00100000:1.0:1789061863.689599:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120254720 00000100:00080000:3.0:1789061863.689647:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789061863.689655:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120254976:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 63us (282us total) trans 0 rc 0/0 00000100:00080000:3.0:1789061863.689657:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061863.689694:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 283 00000100:00100000:1.0:1789061863.689706:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:2393:x1875967120254720:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061863.690232:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 106 00000100:00100000:0.0:1789061863.690974:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120254848:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1510us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061863.690983:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:1.0:1789061863.691197:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:2393:x1875967120254720:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1493us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061863.691206:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 283 00000100:00100000:1.0:1789061864.107233:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130811136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061864.107311:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061864.107396:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130811136 00000100:00100000:1.0:1789061864.107404:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130811136 00000100:00100000:1.0:1789061864.107455:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789061864.107463:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130811136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789061864.107491:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061864.107535:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130811136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061864.107543:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789061864.107563:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061864.107589:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7753480 x1875967130811136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061864.107633:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130811136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061864.107897:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130811264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061864.107926:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061864.108419:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130811264 00000100:00100000:0.0:1789061864.108425:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130811264 00000100:00100000:0.0:1789061864.108467:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789061864.108474:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130811264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061864.108487:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061864.108523:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130811264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061864.108529:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789061864.109072:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061864.109100:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c1c00 x1875967130811264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061864.109116:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130811264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789061864.234857:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061865.260411:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061865.643699:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130811392:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.643902:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061865.644007:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130811904:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.644041:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061865.644065:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130812416:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.644103:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061865.644125:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130812928:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.644146:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061865.644175:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789061865.644181:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130811520:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.644205:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061865.644221:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130812032:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.644240:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061865.644253:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130812544:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.644274:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061865.644439:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130811648:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.644468:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061865.644486:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130812160:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.644506:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061865.644523:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130812672:0@lo:400:kworker.0 00000100:00100000:3.0:1789061865.644528:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130811520 00000100:00100000:3.0:1789061865.644538:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130811520 00000100:00100000:1.0:1789061865.644547:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061865.644566:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789061865.644571:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130811776:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.644590:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061865.644599:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130812288:0@lo:400:kworker.0 00000100:00100000:3.0:1789061865.644618:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130812032 00000100:00100000:3.0:1789061865.644622:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130812032 00000100:00100000:3.0:1789061865.644649:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130812544 00000100:00100000:1.0:1789061865.644651:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061865.644652:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130812544 00000100:00100000:1.0:1789061865.644669:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130812800:0@lo:400:kworker.0 00000100:00100000:3.0:1789061865.644673:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130812160 00000100:00100000:3.0:1789061865.644676:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130812160 00000100:00100000:3.0:1789061865.644688:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130812672 00000100:00100000:1.0:1789061865.644690:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061865.644691:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130812672 00000100:00100000:3.0:1789061865.644701:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130811776 00000100:00100000:3.0:1789061865.644704:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130811776 00000100:00100000:3.0:1789061865.644719:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789061865.644720:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130811904 00000100:00100000:1.0:1789061865.644723:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130811904 00000100:00100000:3.0:1789061865.644728:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130811520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.644746:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130811648 00000100:00100000:1.0:1789061865.644748:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130811648 00000100:00100000:1.0:1789061865.644762:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789061865.644768:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130811904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.644883:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130811904:12345-0@lo:400:kworker.0 Request processed in 114us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061865.644890:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789061865.644910:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789061865.644917:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130811648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.644949:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130811648:12345-0@lo:400:kworker.0 Request processed in 32us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061865.644964:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789061865.644984:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130812416 00000100:00100000:1.0:1789061865.644989:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130812416 00000100:00100000:1.0:1789061865.645005:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130812928 00000100:00100000:1.0:1789061865.645007:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130812928 00000100:00100000:1.0:1789061865.645017:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130812288 00000100:00100000:1.0:1789061865.645019:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130812288 00000100:00100000:1.0:1789061865.645027:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130812800 00000100:00100000:1.0:1789061865.645029:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130812800 00000100:00100000:1.0:1789061865.645042:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789061865.645048:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130812416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.645220:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130812416:12345-0@lo:400:kworker.0 Request processed in 172us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061865.645228:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789061865.645241:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789061865.645247:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130812928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.645277:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130812928:12345-0@lo:400:kworker.0 Request processed in 31us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061865.645283:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789061865.645294:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789061865.645299:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7753100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130812288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061865.645657:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130811392 00000100:00100000:0.0:1789061865.645663:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130811392 00000100:00100000:0.0:1789061865.645696:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789061865.645704:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130811392:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789061865.646745:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061865.646755:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789061865.646758:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061865.647730:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789061865.647759:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130812032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061865.654839:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130811520:12345-0@lo:400:kworker.0 Request processed in 10096us (10615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061865.654859:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789061865.655537:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7753100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130812288:12345-0@lo:400:kworker.0 Request processed in 10232us (10880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061865.655551:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789061865.655583:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789061865.655600:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130812800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.655710:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130812800:12345-0@lo:400:kworker.0 Request processed in 119us (11020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061865.655716:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789061865.655752:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789061865.655761:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130812544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.655794:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130812544:12345-0@lo:400:kworker.0 Request processed in 34us (11519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061865.655799:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789061865.655902:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789061865.655911:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130812160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.655944:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130812160:12345-0@lo:400:kworker.0 Request processed in 36us (11437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061865.655949:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789061865.655961:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789061865.655967:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130812672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.655997:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130812672:12345-0@lo:400:kworker.0 Request processed in 31us (11449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061865.656002:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789061865.656013:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789061865.656020:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130811776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.656069:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130811776:12345-0@lo:400:kworker.0 Request processed in 50us (11478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061865.657716:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789061865.657879:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130811520:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.657922:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130812544:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.657938:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130811904:0@lo:400:kworker.0 00010000:00080000:1.0:1789061865.657953:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c2680 x1875967130812416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061865.657965:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130812416:0@lo:400:kworker.0 00010000:00080000:1.0:1789061865.657978:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd511880 x1875967130812928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061865.657986:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130812928:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.658048:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130811776:0@lo:400:kworker.0 00010000:00080000:1.0:1789061865.658063:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c0380 x1875967130812288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061865.658438:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130812288:0@lo:400:kworker.0 00010000:00080000:1.0:1789061865.658456:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd511500 x1875967130812800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061865.658463:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130812800:0@lo:400:kworker.0 00000100:00100000:1.0:1789061865.658474:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130811648:0@lo:400:kworker.0 00010000:00080000:1.0:1789061865.658485:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c1500 x1875967130812160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061865.658492:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130812160:0@lo:400:kworker.0 00010000:00080000:1.0:1789061865.658502:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd511180 x1875967130812672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061865.658516:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130812672:0@lo:400:kworker.0 00000100:00100000:0.0:1789061865.663527:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130811392:12345-0@lo:400:kworker.0 Request processed in 17813us (19714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061865.663545:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789061865.663754:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130811392:0@lo:400:kworker.0 00000100:00100000:2.0:1789061865.664205:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130812032:12345-0@lo:400:kworker.0 Request processed in 16459us (19960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061865.664218:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789061865.665021:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130812032:0@lo:400:kworker.0 00000100:00100000:1.0:1789061866.153760:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061866.153785:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130813184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061866.153850:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061866.153909:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130813184 00000100:00100000:1.0:1789061866.153921:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130813184 00000100:00100000:1.0:1789061866.153963:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789061866.153971:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130813184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789061866.154000:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789061866.154041:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130813184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061866.154048:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789061866.154092:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130813184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061866.154931:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061866.154944:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130813056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061866.154984:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061866.157541:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130813056 00000100:00100000:1.0:1789061866.157553:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130813056 00000100:00100000:1.0:1789061866.157631:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789061866.157640:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130813056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789061866.157669:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061866.157734:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130813056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061866.157741:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789061866.157790:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c1180 x1875967130813056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061866.157809:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130813056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789061866.162283:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061866.164521:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130813312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061866.164590:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061866.164768:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130813312 00000100:00100000:0.0:1789061866.164777:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130813312 00000100:00100000:0.0:1789061866.164828:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789061866.164836:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130813312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061866.164856:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061866.164909:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130813312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061866.164928:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789061866.165196:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd510e00 x1875967130813312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061866.165216:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130813312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789061866.282787:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061867.306935:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061868.334479:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061868.713779:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061868.713802:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130813440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061868.713879:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061868.714211:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130813440 00000100:00100000:3.0:1789061868.714221:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130813440 00000100:00100000:3.0:1789061868.714289:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789061868.714299:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130813440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789061868.714338:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789061868.714410:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130813440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061868.714417:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789061868.714458:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130813440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061868.809884:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061868.809917:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061868.809938:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061868.809961:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120255360 00000100:00100000:3.0:1789061868.809969:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120255360 00000100:00100000:3.0:1789061868.810016:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120255232 00000100:00100000:3.0:1789061868.810019:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120255232 00000100:00100000:3.0:1789061868.810039:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 113 00000100:00100000:3.0:1789061868.810048:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120255360:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061868.810110:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120255360:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061868.810117:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 113 00000100:00100000:3.0:1789061868.810133:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:3.0:1789061868.810138:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120255232:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061868.810164:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120255232:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061868.810169:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:1.0:1789061868.810764:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120255104 00000100:00100000:1.0:1789061868.810769:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120255104 00000100:00100000:1.0:1789061868.810902:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 285 00000100:00100000:1.0:1789061868.810911:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:2393:x1875967120255104:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061868.810948:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+10:2393:x1875967120255104:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 39us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061868.810955:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 285 00000100:00080000:2.0:1789061868.813846:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789061868.813854:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061869.227036:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130813568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061869.227116:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061869.227211:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130813696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061869.227235:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061869.227314:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130813568 00000100:00100000:3.0:1789061869.227322:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130813568 00000100:00100000:3.0:1789061869.227374:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130813696 00000100:00100000:3.0:1789061869.227378:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130813696 00000100:00100000:3.0:1789061869.227405:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789061869.227412:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130813568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789061869.227455:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061869.227510:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130813568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061869.227517:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789061869.227533:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789061869.227540:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130813696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789061869.227549:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061869.227577:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130813696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061869.227581:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1789061869.227635:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c1180 x1875967130813568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061869.227652:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130813568:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789061869.230480:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061869.230529:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c3480 x1875967130813696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061869.230552:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130813696:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789061869.357020:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061870.378777:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061870.764691:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061870.764715:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130813952:0@lo:400:kworker.0 00000100:00100000:2.0:1789061870.764782:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061870.764803:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061870.764817:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130813824:0@lo:400:kworker.0 00000100:00100000:2.0:1789061870.764845:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130813952 00000100:00100000:2.0:1789061870.764853:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130813952 00000100:00100000:3.0:1789061870.764859:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061870.764905:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789061870.764914:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130813952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.764924:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130813824 00000100:00100000:1.0:1789061870.764931:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130813824 00000100:00100000:1.0:1789061870.764965:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789061870.764974:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130813824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061870.764979:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130813952:12345-0@lo:400:kworker.0 Request processed in 64us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061870.764997:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789061870.765023:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130813824:12345-0@lo:400:kworker.0 Request processed in 50us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061870.765030:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789061870.765044:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130813952:0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.765070:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130814336:0@lo:400:kworker.0 00000100:00100000:3.0:1789061870.765073:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130814080:0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.765114:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061870.765207:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130814464:0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.765213:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130814848:0@lo:400:kworker.0 00000100:00100000:0.0:1789061870.765239:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061870.765261:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061870.765263:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130814976:0@lo:400:kworker.0 00000100:00100000:0.0:1789061870.765289:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061870.765292:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130815360:0@lo:400:kworker.0 00000100:00100000:0.0:1789061870.765313:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789061870.765322:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130814592:0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.765326:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061870.765362:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789061870.765367:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061870.765372:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130814208:0@lo:400:kworker.0 00000100:00100000:0.0:1789061870.765393:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130815104:0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.765401:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061870.765421:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061870.765426:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130814720:0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.765454:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061870.765454:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130814464 00000100:00100000:0.0:1789061870.765460:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130814464 00000100:00100000:1.0:1789061870.765475:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130815232:0@lo:400:kworker.0 00000100:00100000:0.0:1789061870.765497:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130814976 00000100:00100000:1.0:1789061870.765503:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061870.765503:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130814976 00000100:00100000:0.0:1789061870.765520:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130814592 00000100:00100000:0.0:1789061870.765522:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130814592 00000100:00100000:0.0:1789061870.765534:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130814208 00000100:00100000:0.0:1789061870.765537:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130814208 00000100:00100000:1.0:1789061870.765551:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130814848 00000100:00100000:0.0:1789061870.765551:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130815104 00000100:00100000:0.0:1789061870.765557:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130815104 00000100:00100000:1.0:1789061870.765559:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130814848 00000100:00100000:0.0:1789061870.765576:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789061870.765585:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130814464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.765587:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130815360 00000100:00100000:1.0:1789061870.765592:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130815360 00000100:00100000:1.0:1789061870.765632:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130814720 00000100:00100000:1.0:1789061870.765637:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130814720 00000100:00100000:1.0:1789061870.765652:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130815232 00000100:00100000:1.0:1789061870.765655:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130815232 00000100:00100000:0.0:1789061870.765660:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130814464:12345-0@lo:400:kworker.0 Request processed in 75us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061870.765669:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789061870.765673:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789061870.765690:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789061870.765697:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130814976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061870.765733:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130814976:12345-0@lo:400:kworker.0 Request processed in 36us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061870.765738:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789061870.765751:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789061870.765756:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130814592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061870.765780:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130814592:12345-0@lo:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061870.765786:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789061870.765795:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789061870.765800:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130814208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061870.765828:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130814208:12345-0@lo:400:kworker.0 Request processed in 27us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061870.765833:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789061870.765843:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789061870.765849:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130815104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061870.765873:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130815104:12345-0@lo:400:kworker.0 Request processed in 24us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061870.765878:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789061870.765906:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130814848:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789061870.765911:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd514380 x1875967130814592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061870.765924:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130814592:0@lo:400:kworker.0 00010000:00080000:0.0:1789061870.765937:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c672bb80 x1875967130815104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061870.765947:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130815104:0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.765949:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130814848:12345-0@lo:400:kworker.0 Request processed in 267us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061870.765961:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789061870.765972:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130814464:0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.765979:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789061870.765985:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130814976:0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.765991:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130815360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.766025:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130815360:12345-0@lo:400:kworker.0 Request processed in 38us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061870.766037:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789061870.766051:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789061870.766057:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130814720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.766090:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130814720:12345-0@lo:400:kworker.0 Request processed in 33us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061870.766096:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789061870.766109:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061870.766113:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789061870.766121:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130815232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.766297:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130815232:12345-0@lo:400:kworker.0 Request processed in 176us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061870.766303:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789061870.766329:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061870.766345:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789061870.766347:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061870.766366:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130813824:0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.766393:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130814208:0@lo:400:kworker.0 00010000:00080000:1.0:1789061870.766403:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6728000 x1875967130814720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061870.766412:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130814720:0@lo:400:kworker.0 00010000:00080000:1.0:1789061870.766421:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6728380 x1875967130815232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061870.766428:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130815232:0@lo:400:kworker.0 00010000:00080000:1.0:1789061870.766437:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6729880 x1875967130814848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061870.766453:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130814848:0@lo:400:kworker.0 00010000:00080000:1.0:1789061870.766464:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6728e00 x1875967130815360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061870.766472:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130815360:0@lo:400:kworker.0 00000100:00100000:3.0:1789061870.767677:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130814336 00000100:00100000:3.0:1789061870.767747:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130814336 00000100:00100000:1.0:1789061870.767813:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130814080 00000100:00100000:1.0:1789061870.767818:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130814080 00000100:00100000:1.0:1789061870.767866:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789061870.767873:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130814080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061870.767938:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130814080:12345-0@lo:400:kworker.0 Request processed in 65us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061870.767945:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789061870.767981:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130814080:0@lo:400:kworker.0 00000100:00100000:3.0:1789061870.768010:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789061870.768026:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130814336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061870.768129:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130814336:12345-0@lo:400:kworker.0 Request processed in 104us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061870.768138:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789061870.768171:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130814336:0@lo:400:kworker.0 00000100:00100000:3.0:1789061871.274749:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130815488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061871.274815:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061871.274891:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130815488 00000100:00100000:3.0:1789061871.274898:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130815488 00000100:00100000:3.0:1789061871.274939:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789061871.274947:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130815488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061871.274973:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061871.275014:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130815488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061871.275021:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1789061871.275058:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676aa00 x1875967130815488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061871.275076:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130815488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061871.275377:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130815616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061871.275410:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061871.275450:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130815616 00000100:00100000:1.0:1789061871.275454:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130815616 00000100:00100000:1.0:1789061871.275482:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789061871.275489:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130815616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789061871.275511:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789061871.275582:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130815616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061871.275587:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789061871.275645:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130815616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789061871.275906:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789061871.275916:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130815744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789061871.275954:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061871.276813:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130815744 00000100:00100000:3.0:1789061871.276821:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130815744 00000100:00100000:3.0:1789061871.276852:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789061871.276859:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130815744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789061871.276875:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061871.276920:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130815744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061871.276934:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1789061871.277652:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676aa00 x1875967130815744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061871.277670:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130815744:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789061871.402899:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061872.426204:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061873.450705:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789061873.528292:0:11971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 13:37:50 (1789061870) === 00000100:00100000:0.0:1789061873.833823:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130815872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789061873.833895:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061873.834223:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130815872 00000100:00100000:3.0:1789061873.834231:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130815872 00000100:00100000:3.0:1789061873.834330:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789061873.834340:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130815872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789061873.834370:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789061873.834419:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130815872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061873.834436:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789061873.834531:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130815872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061873.912801:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061873.913083:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120255488 00000100:00100000:2.0:1789061873.913094:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120255488 00000100:00100000:2.0:1789061873.913153:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 287 00000100:00100000:2.0:1789061873.913163:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+10:8717:x1875967120255488:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789061873.913180:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061873.913199:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c1483e00/0x2774d8f311dc684d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b762 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061873.913226:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1483e00/0x2774d8f311dc684d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b762 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061873.913237:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c1483e00/0x2774d8f311dc684d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b762 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061873.913245:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c1483e00, rc 0) 00000100:00100000:2.0:1789061873.913303:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+11:8717:x1875967120255488:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 141us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061873.913318:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 287 00000100:00100000:3.0:1789061873.928023:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061873.928132:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120255616 00000100:00100000:1.0:1789061873.928143:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120255616 00000100:00100000:1.0:1789061873.928205:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 288 00000100:00100000:1.0:1789061873.928215:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+11:8717:x1875967120255616:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789061873.928369:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+11:8717:x1875967120255616:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 155us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061873.928377:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 288 00000100:00100000:3.0:1789061873.928931:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061873.929014:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061873.929095:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120255744 00000100:00100000:1.0:1789061873.929100:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120255744 00000100:00100000:1.0:1789061873.929144:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120255872 00000100:00100000:1.0:1789061873.929147:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120255872 00000100:00100000:1.0:1789061873.929167:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:1.0:1789061873.929174:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120255744:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061873.929215:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120255744:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 41us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061873.929221:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:1.0:1789061873.929233:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:1.0:1789061873.929240:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120255872:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061873.929262:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120255872:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061873.929267:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00080000:3.0:1789061873.929807:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789061873.929812:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061873.938793:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061873.939831:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120256000 00000100:00100000:1.0:1789061873.939848:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120256000 00000100:00100000:1.0:1789061873.939932:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 289 00000100:00100000:1.0:1789061873.939944:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+11:8717:x1875967120256000:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789061873.940650:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+11:8717:x1875967120256000:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 706us (1869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061873.940673:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 289 00000100:00100000:0.0:1789061873.945047:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061873.945157:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120256128 00000100:00100000:2.0:1789061873.945171:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120256128 00000100:00100000:2.0:1789061873.945244:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 290 00000100:00100000:2.0:1789061873.945255:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+11:8721:x1875967120256128:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789061873.945442:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+11:8721:x1875967120256128:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 189us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061873.945450:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 290 00000100:00100000:3.0:1789061873.989684:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061873.989901:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120256256 00000100:00100000:1.0:1789061873.989911:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120256256 00000100:00100000:1.0:1789061873.989964:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 291 00000100:00100000:1.0:1789061873.989973:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+11:8721:x1875967120256256:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061873.990119:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+11:8721:x1875967120256256:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 146us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061873.990126:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 291 00000100:00100000:2.0:1789061874.000232:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061874.000399:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120256384 00000100:00100000:0.0:1789061874.000409:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120256384 00000100:00100000:0.0:1789061874.000475:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 292 00000100:00100000:0.0:1789061874.000484:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+11:8721:x1875967120256384:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789061874.000672:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+11:8721:x1875967120256384:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 188us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061874.000681:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 292 00000100:00100000:0.0:1789061874.009245:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061874.012655:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120256512 00000100:00100000:2.0:1789061874.012681:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120256512 00000100:00100000:2.0:1789061874.012854:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 293 00000100:00100000:2.0:1789061874.012867:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+11:8717:x1875967120256512:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789061874.012890:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061874.012921:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c1482600/0x2774d8f311dc6854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b793 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061874.012969:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1482600/0x2774d8f311dc6854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b793 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061874.012984:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c1482600/0x2774d8f311dc6854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b793 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061874.012997:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c1482600, rc 0) 00000100:00100000:2.0:1789061874.013306:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+12:8717:x1875967120256512:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 440us (4073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061874.013323:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 293 00000100:00100000:3.0:1789061874.019281:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061874.019535:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120256640 00000100:00100000:1.0:1789061874.019550:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120256640 00000100:00100000:1.0:1789061874.019654:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 294 00000100:00100000:1.0:1789061874.019666:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+12:8717:x1875967120256640:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789061874.019708:0:6490:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789061874.019738:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789061874.019743:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789061874.019746:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789061874.019749:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789061874.019751:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789061874.022744:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+12:8717:x1875967120256640:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 3065us (3463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.022762:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 294 00000100:00100000:0.0:1789061874.026908:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061874.027184:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120256768 00000100:00100000:1.0:1789061874.027262:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120256768 00000100:00100000:1.0:1789061874.027522:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 295 00000100:00100000:1.0:1789061874.027534:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+12:8717:x1875967120256768:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789061874.027555:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061874.027596:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc685b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b79a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061874.027675:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc685b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b79a expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061874.027819:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc685b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b79a expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061874.027831:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b400, rc 0) 00000100:00100000:1.0:1789061874.027954:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:8717:x1875967120256768:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 422us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.027963:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 295 00000100:00100000:0.0:1789061874.031271:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061874.031569:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120256896 00000100:00100000:1.0:1789061874.031581:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120256896 00000100:00100000:1.0:1789061874.031718:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 296 00000100:00100000:1.0:1789061874.031730:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:8717:x1875967120256896:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789061874.031936:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:8717:x1875967120256896:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 208us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.031945:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 296 00000100:00100000:2.0:1789061874.034799:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061874.034957:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120257024 00000100:00100000:1.0:1789061874.034971:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120257024 00000100:00100000:1.0:1789061874.035111:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 297 00000100:00100000:1.0:1789061874.035125:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:8717:x1875967120257024:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789061874.035904:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:8717:x1875967120257024:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 779us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.035916:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 297 00000100:00100000:2.0:1789061874.041102:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061874.041447:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120257152 00000100:00100000:1.0:1789061874.041461:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120257152 00000100:00100000:1.0:1789061874.041530:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 298 00000100:00100000:1.0:1789061874.041542:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:8726:x1875967120257152:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061874.041871:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:8726:x1875967120257152:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 330us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.041879:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 298 00000100:00100000:2.0:1789061874.047377:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061874.047490:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120257280 00000100:00100000:0.0:1789061874.047504:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120257280 00000100:00100000:0.0:1789061874.047574:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 299 00000100:00100000:0.0:1789061874.047585:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:8726:x1875967120257280:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789061874.047883:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:8726:x1875967120257280:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 298us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061874.047900:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 299 00000100:00100000:2.0:1789061874.059678:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061874.059853:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120257408 00000100:00100000:1.0:1789061874.059867:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120257408 00000100:00100000:1.0:1789061874.059921:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1789061874.059931:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875967120257408:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789061874.059971:0:6497:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a8bf6189-9e16-4d60-bea6-060afd49ee07@192.168.203.3@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1789061874.060019:0:6497:0:(genops.c:1384:class_connect()) connect: client a8bf6189-9e16-4d60-bea6-060afd49ee07, cookie 0x2774d8f311dc6862 00000004:00100000:1.0:1789061874.060053:0:6497:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1789061874.060415:0:6497:0:(import.c:65:import_set_state_nolock()) ffff9766c754a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061874.060513:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2389:x1875967120257408:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 581us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.060523:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:2.0:1789061874.062911:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061874.064185:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120257664 00000100:00100000:1.0:1789061874.064271:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120257664 00000100:00100000:1.0:1789061874.064443:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1789061874.064455:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2389:x1875967120257664:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789061874.065075:0:10077:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from a8bf6189-9e16-4d60-bea6-060afd49ee07@192.168.203.3@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1789061874.065128:0:10077:0:(genops.c:1384:class_connect()) connect: client a8bf6189-9e16-4d60-bea6-060afd49ee07, cookie 0x2774d8f311dc6869 00000004:00100000:1.0:1789061874.065155:0:10077:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1789061874.066459:0:10077:0:(import.c:65:import_set_state_nolock()) ffff9766c754e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061874.066540:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2389:x1875967120257664:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 2084us (3642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.066551:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1789061874.076900:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061874.076956:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061874.077084:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120257792 00000100:00100000:1.0:1789061874.077097:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120257792 00000100:00100000:1.0:1789061874.077190:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120257536 00000100:00100000:1.0:1789061874.077194:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120257536 00000100:00100000:1.0:1789061874.077233:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1789061874.077243:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:0:x1875967120257792:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789061874.077302:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789061874.077418:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:0:x1875967120257792:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 176us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.077426:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1789061874.077449:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1789061874.077455:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:0:x1875967120257536:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789061874.077476:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789061874.077546:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:0:x1875967120257536:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 90us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.077553:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00080000:3.0:1789061874.077998:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061874.078015:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789061874.087468:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061874.087639:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120257920 00000100:00100000:3.0:1789061874.087652:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120257920 00000100:00100000:3.0:1789061874.087737:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:3.0:1789061874.087749:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:8717:x1875967120257920:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789061874.087790:0:10077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789061874.087895:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:8717:x1875967120257920:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 147us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061874.087922:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1789061874.090486:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061874.090658:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120258048 00000100:00100000:3.0:1789061874.090670:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120258048 00000100:00100000:3.0:1789061874.090752:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1789061874.090763:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:8717:x1875967120258048:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789061874.090867:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:8717:x1875967120258048:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 105us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061874.090875:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:0.0:1789061874.095329:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061874.095649:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120258176 00000100:00100000:1.0:1789061874.095662:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120258176 00000100:00100000:1.0:1789061874.095733:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1789061874.095743:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1875967120258176:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789061874.095788:0:8613:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a8bf6189-9e16-4d60-bea6-060afd49ee07@192.168.203.3@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1789061874.095829:0:8613:0:(genops.c:1384:class_connect()) connect: client a8bf6189-9e16-4d60-bea6-060afd49ee07, cookie 0x2774d8f311dc6870 00002000:00100000:1.0:1789061874.095862:0:8613:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a8bf6189-9e16-4d60-bea6-060afd49ee07/ffff9766c754b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789061874.095889:0:8613:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789061874.095996:0:8613:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789061874.096532:0:8613:0:(import.c:65:import_set_state_nolock()) ffff9766c754c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061874.096666:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2389:x1875967120258176:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 919us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.096674:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1789061874.101863:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061874.101921:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061874.102046:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120258432 00000100:00100000:0.0:1789061874.102059:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120258432 00000100:00100000:0.0:1789061874.102131:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:0.0:1789061874.102143:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:8717:x1875967120258432:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789061874.102267:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:8717:x1875967120258432:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 126us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061874.102275:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:1.0:1789061874.103669:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120258304 00000100:00100000:1.0:1789061874.103682:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120258304 00000100:00100000:1.0:1789061874.103800:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:1.0:1789061874.103808:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875967120258304:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789061874.103847:0:8412:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a8bf6189-9e16-4d60-bea6-060afd49ee07@192.168.203.3@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1789061874.103887:0:8412:0:(genops.c:1384:class_connect()) connect: client a8bf6189-9e16-4d60-bea6-060afd49ee07, cookie 0x2774d8f311dc6877 00002000:00100000:1.0:1789061874.103901:0:8412:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a8bf6189-9e16-4d60-bea6-060afd49ee07/ffff9766c754f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789061874.103924:0:8412:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789061874.104113:0:8412:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789061874.104157:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9766c7548800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789061874.104459:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2389:x1875967120258304:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 648us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.104468:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1789061874.107224:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061874.108812:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120258560 00000100:00100000:1.0:1789061874.108831:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120258560 00000100:00100000:1.0:1789061874.108919:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:1.0:1789061874.108932:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:8717:x1875967120258560:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789061874.109137:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789061874.109547:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:8717:x1875967120258560:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 617us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.109557:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:3.0:1789061874.346969:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130816000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061874.347088:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061874.347278:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130816000 00000100:00100000:0.0:1789061874.347299:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130816000 00000100:00100000:0.0:1789061874.347394:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789061874.347406:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130816000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061874.347435:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061874.348059:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130816128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061874.348125:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061874.348207:0:8415:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789061874.348218:0:8415:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:1.0:1789061874.348246:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061874.348781:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130816128 00000100:00100000:1.0:1789061874.348789:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130816128 00000100:00080000:1.0:1789061874.348840:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061874.349112:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789061874.349126:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130816128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789061874.349255:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061874.350445:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130816128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1319us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061874.350886:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1789061874.350968:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b7100 x1875967130816128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061874.351892:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130816128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789061874.354075:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130816000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6657us (6973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061874.354092:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789061874.354453:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7714000 x1875967130816000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061874.354481:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130816000:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789061874.477935:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061875.498342:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061875.881768:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130816256:0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.881814:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130816512:0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.881852:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061875.881858:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061875.881910:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130816768:0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.881935:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061875.881955:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130817280:0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.881975:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061875.881994:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130817792:0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.882026:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061875.882046:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789061875.882052:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130816384:0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.882076:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061875.882093:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130816896:0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.882113:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061875.882129:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130817408:0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.882147:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061875.882177:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130816256 00000100:00100000:0.0:1789061875.882183:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130816256 00000100:00100000:0.0:1789061875.882227:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1789061875.882236:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130816256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.882289:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130816256:12345-0@lo:400:kworker.0 Request processed in 48us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061875.882304:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1789061875.882340:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130816512 00000100:00100000:0.0:1789061875.882344:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130816512 00000100:00100000:0.0:1789061875.882367:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130816768 00000100:00100000:0.0:1789061875.882370:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130816768 00000100:00100000:0.0:1789061875.882384:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789061875.882391:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130816512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.882425:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130816512:12345-0@lo:400:kworker.0 Request processed in 34us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061875.882431:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789061875.882448:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789061875.882455:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130816768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.882499:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130816768:12345-0@lo:400:kworker.0 Request processed in 45us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061875.882505:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789061875.882524:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130817280 00000100:00100000:0.0:1789061875.882527:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130817280 00000100:00100000:0.0:1789061875.882553:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130817792 00000100:00100000:0.0:1789061875.882555:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130817792 00000100:00100000:0.0:1789061875.882581:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789061875.882587:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130817280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.882870:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130817280:12345-0@lo:400:kworker.0 Request processed in 281us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061875.882878:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789061875.882893:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789061875.882901:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130817792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.882931:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130817792:12345-0@lo:400:kworker.0 Request processed in 31us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061875.882937:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789061875.882956:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130816384 00000100:00100000:0.0:1789061875.882960:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130816384 00000100:00100000:0.0:1789061875.882986:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130816896 00000100:00100000:0.0:1789061875.882989:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130816896 00000100:00100000:0.0:1789061875.883011:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130817408 00000100:00100000:0.0:1789061875.883014:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130817408 00000100:00100000:0.0:1789061875.883033:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789061875.883040:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130816384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.883602:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130816384:12345-0@lo:400:kworker.0 Request processed in 561us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061875.883630:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789061875.883657:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789061875.883665:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130816896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.883701:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130816896:12345-0@lo:400:kworker.0 Request processed in 38us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061875.883708:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789061875.883721:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789061875.883728:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130817408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.883761:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130817408:12345-0@lo:400:kworker.0 Request processed in 34us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061875.883767:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789061875.883848:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130816384:0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.883861:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130816896:0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.883871:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130817408:0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.883882:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130816768:0@lo:400:kworker.0 00010000:00080000:0.0:1789061875.883893:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7717100 x1875967130817280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061875.883904:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130817280:0@lo:400:kworker.0 00010000:00080000:0.0:1789061875.883915:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7715c00 x1875967130817792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061875.883923:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130817792:0@lo:400:kworker.0 00000100:00100000:0.0:1789061875.883932:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130816256:0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.884705:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130816512:0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.884719:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130817024:0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.884755:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061875.884789:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130817536:0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.884811:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061875.884839:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789061875.884845:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130816640:0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.884863:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061875.884879:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130817152:0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.884899:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061875.884916:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130817664:0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.884936:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061875.884973:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130817152 00000100:00100000:1.0:1789061875.884979:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130817152 00000100:00100000:1.0:1789061875.885003:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130817664 00000100:00100000:1.0:1789061875.885006:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130817664 00000100:00100000:1.0:1789061875.885023:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789061875.885029:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130817152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.885069:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130817152:12345-0@lo:400:kworker.0 Request processed in 39us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061875.885076:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789061875.885089:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789061875.885095:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130817664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.885121:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130817664:12345-0@lo:400:kworker.0 Request processed in 25us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061875.885126:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789061875.885144:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061875.885149:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789061875.885156:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130817024 00000100:00100000:1.0:1789061875.885160:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130817024 00000100:00100000:1.0:1789061875.885192:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130817536 00000100:00100000:1.0:1789061875.885196:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130817536 00000100:00100000:1.0:1789061875.885212:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130816640 00000100:00100000:1.0:1789061875.885215:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130816640 00000100:00100000:1.0:1789061875.885228:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789061875.885233:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130817024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.885262:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130817024:12345-0@lo:400:kworker.0 Request processed in 29us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061875.885269:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789061875.885281:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789061875.885287:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130817536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.885325:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130817536:12345-0@lo:400:kworker.0 Request processed in 38us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061875.885331:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789061875.885342:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789061875.885348:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130816640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061875.885372:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130816640:12345-0@lo:400:kworker.0 Request processed in 25us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061875.885377:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1789061875.885389:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061875.885430:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130816640:0@lo:400:kworker.0 00010000:00080000:1.0:1789061875.885441:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7714a80 x1875967130817152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061875.885449:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130817152:0@lo:400:kworker.0 00010000:00080000:1.0:1789061875.885458:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7714700 x1875967130817664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061875.885477:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130817664:0@lo:400:kworker.0 00010000:00080000:1.0:1789061875.885489:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7715f80 x1875967130817024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061875.885497:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130817024:0@lo:400:kworker.0 00010000:00080000:1.0:1789061875.885506:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7716300 x1875967130817536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061875.885514:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130817536:0@lo:400:kworker.0 00000100:00100000:0.0:1789061876.393827:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130817920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061876.393906:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061876.394004:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130817920 00000100:00100000:1.0:1789061876.394014:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130817920 00000100:00100000:1.0:1789061876.394066:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789061876.394075:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130817920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789061876.394104:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789061876.394148:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130817920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061876.394156:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789061876.394233:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130817920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061876.397744:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130818048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061876.397807:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061876.397902:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130818048 00000100:00100000:1.0:1789061876.397910:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130818048 00000100:00100000:1.0:1789061876.397967:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789061876.397976:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130818048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061876.398003:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061876.398060:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130818048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061876.398067:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1789061876.398344:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7715f80 x1875967130818048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061876.398362:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130818048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061876.404280:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130818176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061876.404363:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061876.404447:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130818176 00000100:00100000:2.0:1789061876.404455:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130818176 00000100:00100000:2.0:1789061876.404509:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789061876.404518:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130818176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789061876.404540:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061876.407838:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130818176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3311us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061876.407852:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1789061876.409245:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fb0af100 x1875967130818176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061876.409270:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130818176:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789061876.525797:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061877.558092:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061878.569827:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061878.954017:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130818304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061878.954088:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061878.955315:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130818304 00000100:00100000:1.0:1789061878.955343:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130818304 00000100:00100000:1.0:1789061878.955403:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789061878.955413:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130818304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789061878.955448:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789061878.955517:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130818304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061878.955525:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789061878.955675:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130818304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789061879.465792:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130818432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061879.465882:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061879.465927:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130818560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061879.465959:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061879.465992:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130818432 00000100:00100000:0.0:1789061879.466002:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130818432 00000100:00100000:0.0:1789061879.466069:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130818560 00000100:00100000:0.0:1789061879.466073:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130818560 00000100:00100000:0.0:1789061879.466093:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789061879.466105:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130818432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789061879.466140:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061879.466188:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130818432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061879.466196:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789061879.466218:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789061879.466224:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130818560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061879.466249:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061879.466289:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130818560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061879.466295:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1789061879.466336:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd511180 x1875967130818560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061879.466355:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130818560:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789061879.466422:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061879.466443:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7714700 x1875967130818432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061879.466456:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130818432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789061879.561170:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061879.561205:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061879.561249:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061879.561291:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061879.561323:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061879.561341:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061879.561363:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061879.561390:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120258816 00000100:00100000:3.0:1789061879.561401:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120258816 00000100:00100000:3.0:1789061879.561463:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120259072 00000100:00100000:3.0:1789061879.561465:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120259072 00000100:00100000:3.0:1789061879.561476:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120258944 00000100:00100000:3.0:1789061879.561478:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120258944 00000100:00100000:3.0:1789061879.561491:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120259200 00000100:00100000:3.0:1789061879.561493:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120259200 00000100:00100000:3.0:1789061879.561509:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:3.0:1789061879.561519:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120258816:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061879.561603:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120258816:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 86us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061879.561635:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:3.0:1789061879.561654:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:3.0:1789061879.561659:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2393:x1875967120259072:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061879.561681:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2393:x1875967120259072:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061879.561687:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:3.0:1789061879.561697:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:3.0:1789061879.561703:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120258944:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061879.561942:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120258944:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 238us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061879.561960:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:3.0:1789061879.561974:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:3.0:1789061879.561980:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2393:x1875967120259200:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061879.562005:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2393:x1875967120259200:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061879.562010:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:3.0:1789061879.562033:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120259328 00000100:00100000:3.0:1789061879.562036:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120259328 00000100:00100000:3.0:1789061879.562064:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120259456 00000100:00100000:3.0:1789061879.562067:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120259456 00000100:00100000:3.0:1789061879.562084:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:3.0:1789061879.562090:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2393:x1875967120259328:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061879.562112:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2393:x1875967120259328:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061879.562118:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:3.0:1789061879.562128:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:3.0:1789061879.562132:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2393:x1875967120259456:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061879.562148:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2393:x1875967120259456:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 16us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061879.562154:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00080000:3.0:1789061879.562177:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061879.562181:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789061879.562184:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789061879.562187:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061879.563155:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120258688 00000100:00100000:1.0:1789061879.563165:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120258688 00000100:00100000:1.0:1789061879.563383:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 301 00000100:00100000:1.0:1789061879.563393:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2393:x1875967120258688:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061879.566941:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2393:x1875967120258688:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 215us (2315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061879.566961:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 301 00010000:00010000:3.0:1789061879.606082:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789061879.909879:0:12165:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:3.0:1789061879.983542:0:6474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a8bf6189-9e16-4d60-bea6-060afd49ee07 00000001:00100000:3.0:1789061879.983855:0:7427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a8bf6189-9e16-4d60-bea6-060afd49ee07 00000001:00100000:0.0:1789061879.986816:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a8bf6189-9e16-4d60-bea6-060afd49ee07 00000001:00100000:0.0:1789061879.992791:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a8bf6189-9e16-4d60-bea6-060afd49ee07 00010000:00010000:0.0:1789061880.617954:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061881.002015:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130819072:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002095:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002159:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130819584:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002196:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002226:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130820096:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002249:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002300:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789061881.002310:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130818688:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002345:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002369:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130819200:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002402:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002431:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130819712:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002463:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002491:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130820224:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002538:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002584:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130818944:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002667:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002691:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130819456:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002711:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002728:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c751ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130819968:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002744:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002762:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789061881.002767:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130818816:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002785:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002802:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130819328:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002820:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002833:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c751a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130819840:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.002849:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061881.002868:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130819072 00000100:00100000:0.0:1789061881.002875:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130819072 00000100:00100000:0.0:1789061881.002907:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130819456 00000100:00100000:0.0:1789061881.002910:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130819456 00000100:00100000:0.0:1789061881.002930:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130819968 00000100:00100000:0.0:1789061881.002932:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130819968 00000100:00100000:0.0:1789061881.002942:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130818816 00000100:00100000:0.0:1789061881.002945:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130818816 00000100:00100000:0.0:1789061881.002953:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130819328 00000100:00100000:0.0:1789061881.002955:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130819328 00000100:00100000:0.0:1789061881.002965:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130819840 00000100:00100000:0.0:1789061881.002967:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130819840 00000100:00100000:0.0:1789061881.002981:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789061881.002988:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130819072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003044:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130819072:12345-0@lo:400:kworker.0 Request processed in 56us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003051:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789061881.003067:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789061881.003074:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130819456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003104:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130819456:12345-0@lo:400:kworker.0 Request processed in 32us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003110:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789061881.003121:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789061881.003126:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130819968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003148:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130819968:12345-0@lo:400:kworker.0 Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003153:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789061881.003162:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789061881.003167:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c751b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130818816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003192:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c751b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130818816:12345-0@lo:400:kworker.0 Request processed in 25us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003197:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789061881.003207:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789061881.003212:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c751b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130819328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003236:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c751b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130819328:12345-0@lo:400:kworker.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003241:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789061881.003251:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789061881.003255:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130819840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003300:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130819840:12345-0@lo:400:kworker.0 Request processed in 44us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003305:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789061881.003324:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130819584 00000100:00100000:0.0:1789061881.003328:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130819584 00000100:00100000:0.0:1789061881.003344:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130820096 00000100:00100000:0.0:1789061881.003346:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130820096 00000100:00100000:0.0:1789061881.003357:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130819712 00000100:00100000:0.0:1789061881.003359:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130819712 00000100:00100000:0.0:1789061881.003367:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130820224 00000100:00100000:0.0:1789061881.003370:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130820224 00000100:00100000:0.0:1789061881.003380:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789061881.003385:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130819584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003425:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130819584:12345-0@lo:400:kworker.0 Request processed in 39us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003431:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789061881.003442:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789061881.003448:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130820096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003472:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130820096:12345-0@lo:400:kworker.0 Request processed in 25us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003477:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789061881.003487:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789061881.003493:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c751b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130819712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003517:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c751b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130819712:12345-0@lo:400:kworker.0 Request processed in 25us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003523:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789061881.003532:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789061881.003544:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c751aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130820224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003576:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c751aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130820224:12345-0@lo:400:kworker.0 Request processed in 33us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003581:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789061881.003603:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130818688 00000100:00100000:0.0:1789061881.003624:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130818688 00000100:00100000:0.0:1789061881.003662:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789061881.003670:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130818688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003712:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130818688:12345-0@lo:400:kworker.0 Request processed in 43us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003720:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789061881.003755:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130819200 00000100:00100000:0.0:1789061881.003761:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130819200 00000100:00100000:0.0:1789061881.003791:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130818944 00000100:00100000:0.0:1789061881.003796:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130818944 00000100:00100000:0.0:1789061881.003816:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789061881.003825:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130819200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003871:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130819200:12345-0@lo:400:kworker.0 Request processed in 46us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003878:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789061881.003896:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789061881.003905:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c751a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130818944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.003947:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c751a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130818944:12345-0@lo:400:kworker.0 Request processed in 43us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.003953:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1789061881.004000:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061881.004006:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789061881.004019:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061881.004022:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789061881.004068:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130818816:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.004082:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130819328:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.004091:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c751a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130819840:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.004098:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130818944:0@lo:400:kworker.0 00010000:00080000:0.0:1789061881.004108:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd515f80 x1875967130819456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061881.004117:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130819456:0@lo:400:kworker.0 00010000:00080000:0.0:1789061881.004127:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c751ad80 x1875967130819968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061881.004136:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c751ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130819968:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.004189:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130818688:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.004204:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130819200:0@lo:400:kworker.0 00010000:00080000:0.0:1789061881.004217:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7518380 x1875967130819712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061881.004226:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130819712:0@lo:400:kworker.0 00010000:00080000:0.0:1789061881.004237:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7519500 x1875967130820224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061881.004245:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130820224:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.004254:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130819072:0@lo:400:kworker.0 00010000:00080000:0.0:1789061881.004284:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd514380 x1875967130819584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061881.004292:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130819584:0@lo:400:kworker.0 00010000:00080000:0.0:1789061881.004302:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7519180 x1875967130820096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061881.004309:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130820096:0@lo:400:kworker.0 00000100:00100000:0.0:1789061881.513841:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130820352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061881.513941:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061881.514023:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130820352 00000100:00100000:2.0:1789061881.514032:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130820352 00000100:00100000:2.0:1789061881.514088:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789061881.514098:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f85450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130820352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789061881.514130:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789061881.514378:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f85450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130820352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 281us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061881.514385:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789061881.515949:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130820352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061881.519264:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130820480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061881.519333:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061881.522318:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130820480 00000100:00100000:3.0:1789061881.522334:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130820480 00000100:00100000:0.0:1789061881.522799:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789061881.522810:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130820480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789061881.522840:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061881.522920:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130820480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (3587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061881.522928:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1789061881.522985:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fb0aed80 x1875967130820480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061881.523005:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130820480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061881.524404:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061881.524421:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130820608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061881.524477:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061881.524581:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130820608 00000100:00100000:2.0:1789061881.524588:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130820608 00000100:00100000:2.0:1789061881.524644:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789061881.524667:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130820608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061881.524684:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061881.524724:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130820608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061881.524731:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1789061881.524803:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b7480 x1875967130820608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061881.524819:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130820608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789061881.643779:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061882.666351:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061883.690949:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061884.074118:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130820736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061884.074184:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061884.074852:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130820736 00000100:00100000:0.0:1789061884.074859:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130820736 00000100:00100000:0.0:1789061884.074908:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789061884.074916:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130820736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789061884.074950:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789061884.078688:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130820736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3765us (4496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061884.078709:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789061884.078913:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130820736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061884.587457:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130820864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061884.587524:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061884.587591:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130820864 00000100:00100000:2.0:1789061884.587598:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130820864 00000100:00100000:2.0:1789061884.587664:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789061884.587675:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130820864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061884.587703:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061884.587744:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130820864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061884.587751:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1789061884.587770:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061884.587797:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b6680 x1875967130820864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061884.587814:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130820864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061884.588037:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061884.588046:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130820992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061884.588075:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061884.588361:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130820992 00000100:00100000:2.0:1789061884.588366:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130820992 00000100:00100000:2.0:1789061884.588406:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789061884.588413:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130820992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789061884.588425:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061884.588461:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130820992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061884.588478:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1789061884.588507:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b6680 x1875967130820992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061884.588519:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130820992:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789061884.588559:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061884.679981:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061884.680028:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061884.680060:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061884.680111:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061884.680135:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061884.680153:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061884.680173:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061884.680281:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120259584 00000100:00100000:1.0:1789061884.680291:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120259584 00000100:00100000:1.0:1789061884.680350:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 303 00000100:00100000:1.0:1789061884.680361:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120259584:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061884.680426:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120259584:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 67us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061884.680433:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 303 00000100:00100000:0.0:1789061884.680530:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120259840 00000100:00100000:0.0:1789061884.680535:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120259840 00000100:00100000:0.0:1789061884.680576:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120260096 00000100:00100000:0.0:1789061884.680579:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120260096 00000100:00100000:0.0:1789061884.680595:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120259712 00000100:00100000:0.0:1789061884.680598:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120259712 00000100:00100000:2.0:1789061884.680647:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120259968 00000100:00100000:2.0:1789061884.680653:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120259968 00000100:00100000:0.0:1789061884.680673:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:0.0:1789061884.680683:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120259840:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061884.680690:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:2.0:1789061884.680701:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120260096:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061884.680718:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120259840:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 36us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061884.680726:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:2.0:1789061884.680739:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120260096:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 40us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061884.680745:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:2.0:1789061884.680753:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:0.0:1789061884.680758:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120259712:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061884.680774:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:2.0:1789061884.680783:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120259968:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061884.680790:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120259712:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 35us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061884.680798:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:2.0:1789061884.680818:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120259968:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 35us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061884.680820:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120260352 00000100:00100000:0.0:1789061884.680826:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120260352 00000100:00100000:2.0:1789061884.680829:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:0.0:1789061884.680857:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120260224 00000100:00100000:0.0:1789061884.680861:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120260224 00000100:00100000:0.0:1789061884.680889:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:2.0:1789061884.680897:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:0.0:1789061884.680899:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120260352:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061884.680909:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120260224:12345-192.168.203.3@tcp:400:kworker.0 00000100:00080000:1.0:1789061884.681298:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061884.681303:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061884.681305:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061884.681308:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789061884.681454:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120260352:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 556us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061884.681462:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:2.0:1789061884.683921:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120260224:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 3005us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061884.683934:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00010000:00010000:3.0:1789061884.714749:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061885.737860:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061886.122397:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130821120:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.122482:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061886.122562:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130821632:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.122598:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061886.122648:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130821376:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.122670:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130822144:0@lo:400:kworker.0 00000100:00100000:3.0:1789061886.122682:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061886.122705:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061886.122713:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130821888:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.122732:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130822656:0@lo:400:kworker.0 00000100:00100000:3.0:1789061886.122742:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061886.122761:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061886.122764:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130822400:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.122789:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789061886.122796:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061886.122801:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130821248:0@lo:400:kworker.0 00000100:00100000:3.0:1789061886.122821:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789061886.122830:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130821504:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.122834:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061886.122860:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061886.122863:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130821760:0@lo:400:kworker.0 00000100:00100000:3.0:1789061886.122881:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130822016:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.122892:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061886.122966:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130821632 00000100:00100000:0.0:1789061886.122973:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130821632 00000100:00100000:0.0:1789061886.123011:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130821376 00000100:00100000:0.0:1789061886.123014:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130821376 00000100:00100000:0.0:1789061886.123030:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789061886.123037:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130821632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.125906:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130822272:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.125971:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061886.126022:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789061886.126032:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130821632:12345-0@lo:400:kworker.0 Request processed in 2992us (3430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061886.126039:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130821376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061886.126047:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789061886.126090:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130821376:12345-0@lo:400:kworker.0 Request processed in 58us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061886.126096:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789061886.126122:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130822144 00000100:00100000:2.0:1789061886.126129:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130822144 00000100:00100000:0.0:1789061886.126147:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130821888 00000100:00100000:0.0:1789061886.126154:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130821888 00000100:00100000:2.0:1789061886.126173:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130822656 00000100:00100000:2.0:1789061886.126178:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130822656 00000100:00100000:2.0:1789061886.126201:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789061886.126208:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130822144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061886.126247:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130822400 00000100:00100000:0.0:1789061886.126251:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130822400 00000100:00100000:0.0:1789061886.126266:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130821248 00000100:00100000:0.0:1789061886.126269:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130821248 00000100:00100000:0.0:1789061886.126278:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130821504 00000100:00100000:0.0:1789061886.126281:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130821504 00000100:00100000:0.0:1789061886.126290:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130821760 00000100:00100000:0.0:1789061886.126293:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130821760 00000100:00100000:0.0:1789061886.126303:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130822272 00000100:00100000:0.0:1789061886.126305:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130822272 00000100:00100000:0.0:1789061886.126318:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789061886.126324:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130821888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.127141:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130822144:12345-0@lo:400:kworker.0 Request processed in 930us (4433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061886.127159:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789061886.127182:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789061886.127190:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130822656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.127223:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130822656:12345-0@lo:400:kworker.0 Request processed in 35us (4463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061886.127242:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789061886.127270:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789061886.127277:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130822400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.127307:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130822400:12345-0@lo:400:kworker.0 Request processed in 30us (4513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061886.127313:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789061886.127325:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789061886.127331:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130821248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.127356:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130821248:12345-0@lo:400:kworker.0 Request processed in 26us (4526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061886.127361:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789061886.127372:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789061886.127377:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130821504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.127401:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130821504:12345-0@lo:400:kworker.0 Request processed in 24us (4542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061886.127406:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789061886.127484:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789061886.127491:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130821760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.127645:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130821760:12345-0@lo:400:kworker.0 Request processed in 154us (4753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061886.127656:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789061886.127670:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789061886.127676:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130822272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.127706:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130822272:12345-0@lo:400:kworker.0 Request processed in 31us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061886.127712:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1789061886.127735:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789061886.127740:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061886.127742:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789061886.127744:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061886.127929:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130821120 00000100:00100000:2.0:1789061886.127936:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130821120 00000100:00100000:0.0:1789061886.127964:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130821888:12345-0@lo:400:kworker.0 Request processed in 844us (4427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061886.127976:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789061886.128035:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130821248:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.128044:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789061886.128052:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130821760:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.128054:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130821120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061886.128072:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130822272:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.128094:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130821120:12345-0@lo:400:kworker.0 Request processed in 42us (5611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061886.128100:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00080000:0.0:1789061886.128169:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6728700 x1875967130822144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061886.128217:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130822144:0@lo:400:kworker.0 00010000:00080000:0.0:1789061886.128238:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c1500 x1875967130822656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061886.128246:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130822656:0@lo:400:kworker.0 00000100:00100000:0.0:1789061886.128255:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130821632:0@lo:400:kworker.0 00000100:00100000:0.0:1789061886.128262:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130821120:0@lo:400:kworker.0 00000100:00100000:3.0:1789061886.128707:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061886.128741:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130822528:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.128759:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130822016 00000100:00100000:2.0:1789061886.128765:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130822016 00000100:00100000:3.0:1789061886.128781:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061886.128812:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130821376:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.128821:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130822528 00010000:00080000:3.0:1789061886.128831:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c672a680 x1875967130821888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061886.128834:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130822528 00000100:00100000:0.0:1789061886.128844:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789061886.128847:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130821888:0@lo:400:kworker.0 00000100:00100000:0.0:1789061886.128859:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130822016:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789061886.128866:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c1880 x1875967130822400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061886.128867:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789061886.128880:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130822400:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.128882:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130822528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061886.128908:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130822016:12345-0@lo:400:kworker.0 Request processed in 53us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061886.128917:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789061886.128921:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130821504:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.128929:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130822528:12345-0@lo:400:kworker.0 Request processed in 52us (158us total) trans 0 rc 0/0 00000100:00080000:0.0:1789061886.128955:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061886.128961:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789061886.128969:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6729f80 x1875967130822016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061886.128978:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130822016:0@lo:400:kworker.0 00010000:00080000:3.0:1789061886.128994:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c2300 x1875967130822528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061886.129002:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130822528:0@lo:400:kworker.0 00000100:00100000:2.0:1789061886.129665:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789061886.635079:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130822784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061886.635286:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061886.635380:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130822784 00000100:00100000:3.0:1789061886.635389:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130822784 00000100:00100000:3.0:1789061886.635445:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789061886.635455:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130822784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061886.635491:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061886.635541:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130822784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061886.635548:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789061886.636950:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061886.636966:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130822912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061886.637012:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061886.637052:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130822912 00000100:00100000:1.0:1789061886.637057:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130822912 00000100:00100000:1.0:1789061886.637085:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789061886.637090:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130822912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789061886.637105:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061886.637142:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130822912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061886.637149:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1789061886.637211:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7715500 x1875967130822912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061886.637242:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130822912:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789061886.640089:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f4507480 x1875967130822784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061886.640123:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130822784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061886.644380:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130823040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061886.644477:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061886.647396:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130823040 00000100:00100000:0.0:1789061886.647416:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130823040 00000100:00100000:0.0:1789061886.647493:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789061886.647506:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130823040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789061886.647559:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789061886.649263:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130823040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1750us (4776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061886.649292:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789061886.649374:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130823040:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789061886.766624:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789061886.820848:0:12480:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789061886.821095:0:12480:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789061887.799039:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789061888.586900:0:12577:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789061888.587096:0:12577:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789061888.811297:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061889.194100:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061889.194283:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130823168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061889.194358:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061889.194935:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130823168 00000100:00100000:0.0:1789061889.194943:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130823168 00000100:00100000:0.0:1789061889.195033:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789061889.195042:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130823168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789061889.195075:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789061889.195133:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130823168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061889.195140:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789061889.195230:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130823168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061889.705867:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130823296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061889.705966:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061889.706067:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130823296 00000100:00100000:2.0:1789061889.706078:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130823296 00000100:00080000:0.0:1789061889.706152:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061889.706157:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789061889.706171:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130823296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789061889.706221:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061889.706282:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130823296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061889.706291:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1789061889.706365:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b5f80 x1875967130823296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061889.706388:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130823296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061889.706522:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130823424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061889.706556:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061889.708213:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130823424 00000100:00100000:1.0:1789061889.708228:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130823424 00000100:00100000:1.0:1789061889.708338:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789061889.708350:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130823424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061889.708377:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061889.708468:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130823424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061889.708476:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1789061889.708830:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7715500 x1875967130823424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061889.708876:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130823424:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789061889.714715:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061889.810133:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061889.810177:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061889.810224:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120260608 00000100:00100000:1.0:1789061889.810235:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120260608 00000100:00100000:1.0:1789061889.810310:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120260864 00000100:00100000:1.0:1789061889.810313:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120260864 00000100:00100000:1.0:1789061889.810347:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:1.0:1789061889.810361:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120260608:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061889.810461:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120260608:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 103us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061889.810469:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:1.0:1789061889.810493:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:1.0:1789061889.810500:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120260864:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061889.810527:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120260864:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061889.810532:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00080000:1.0:1789061889.810552:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061889.810592:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061889.811551:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061889.811672:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061889.811696:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061889.811720:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061889.811806:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120260480 00000100:00100000:1.0:1789061889.811813:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120260480 00000100:00100000:1.0:1789061889.811862:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 305 00000100:00100000:1.0:1789061889.811871:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120260480:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061889.811938:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120260480:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 59us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061889.811947:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 305 00000100:00100000:1.0:1789061889.811986:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120260736 00000100:00100000:1.0:1789061889.811991:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120260736 00000100:00100000:1.0:1789061889.812021:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120260992 00000100:00100000:1.0:1789061889.812025:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120260992 00000100:00100000:1.0:1789061889.812039:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:1.0:1789061889.812045:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120260736:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061889.812074:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120260736:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061889.812081:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:1.0:1789061889.812093:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:1.0:1789061889.812099:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120260992:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061889.812119:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120260992:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061889.812125:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00080000:1.0:1789061889.812193:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789061889.812853:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120261120 00000100:00100000:0.0:1789061889.812862:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120261120 00000100:00100000:0.0:1789061889.813341:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120261248 00000100:00100000:0.0:1789061889.813346:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120261248 00000100:00100000:0.0:1789061889.813507:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:0.0:1789061889.813520:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120261120:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061889.813534:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:3.0:1789061889.813547:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120261248:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061889.813591:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120261120:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 74us (2998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061889.813593:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120261248:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 48us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061889.813696:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:3.0:1789061889.813729:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00080000:0.0:1789061889.813985:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061889.813996:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789061889.835165:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061890.858310:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789061891.005039:0:12676:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789061891.005818:0:12676:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789061891.245824:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130823680:0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.245999:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061891.246068:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130824192:0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.247014:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061891.247069:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130824704:0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.247348:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061891.247383:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789061891.247390:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130823808:0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.247419:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061891.247440:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130824320:0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.247558:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061891.247579:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130824832:0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.247639:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061891.247687:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130823680 00000100:00100000:2.0:1789061891.247698:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130823680 00000100:00100000:2.0:1789061891.247747:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130824192 00000100:00100000:2.0:1789061891.247751:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130824192 00000100:00100000:2.0:1789061891.247781:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130824704 00000100:00100000:2.0:1789061891.247784:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130824704 00000100:00100000:2.0:1789061891.247798:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130824320 00000100:00100000:2.0:1789061891.247800:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130824320 00000100:00100000:2.0:1789061891.247813:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130824832 00000100:00100000:2.0:1789061891.247815:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130824832 00000100:00100000:2.0:1789061891.247832:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789061891.247842:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130823680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.247917:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130823680:12345-0@lo:400:kworker.0 Request processed in 76us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061891.247925:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789061891.247946:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789061891.247953:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130824192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.247983:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130824192:12345-0@lo:400:kworker.0 Request processed in 31us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061891.247989:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789061891.248001:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789061891.248007:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130824704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.248032:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130824704:12345-0@lo:400:kworker.0 Request processed in 25us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061891.248037:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789061891.248048:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789061891.248054:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130824320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.248097:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130824320:12345-0@lo:400:kworker.0 Request processed in 43us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061891.248104:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789061891.248125:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789061891.248132:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130824832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.248160:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130824832:12345-0@lo:400:kworker.0 Request processed in 29us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061891.248166:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789061891.248207:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130823808 00000100:00100000:2.0:1789061891.248212:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130823808 00000100:00100000:2.0:1789061891.248240:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789061891.248247:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130823808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.248280:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130823808:12345-0@lo:400:kworker.0 Request processed in 34us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061891.248286:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1789061891.248310:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789061891.248315:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061891.248354:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130823808:0@lo:400:kworker.0 00010000:00080000:2.0:1789061891.248370:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676d180 x1875967130824320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061891.248380:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130824320:0@lo:400:kworker.0 00010000:00080000:2.0:1789061891.248390:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676ea00 x1875967130824832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061891.248397:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130824832:0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.248420:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130823680:0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.248430:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130824192:0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.248439:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130824704:0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.252080:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130823936:0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.252222:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061891.252299:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130824448:0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.252329:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061891.252357:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130824960:0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.252380:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061891.252420:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789061891.252429:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130823552:0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.252462:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061891.252488:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130824064:0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.252514:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061891.252538:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130824576:0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.252560:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061891.252579:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130825088:0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.252600:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061891.252662:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130824448 00000100:00100000:1.0:1789061891.252673:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130824448 00000100:00100000:1.0:1789061891.252736:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130824960 00000100:00100000:1.0:1789061891.252739:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130824960 00000100:00100000:1.0:1789061891.252755:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130824576 00000100:00100000:1.0:1789061891.252758:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130824576 00000100:00100000:1.0:1789061891.252771:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130825088 00000100:00100000:1.0:1789061891.252773:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130825088 00000100:00100000:1.0:1789061891.252793:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789061891.252804:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130824448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.252868:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130824448:12345-0@lo:400:kworker.0 Request processed in 66us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061891.252902:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789061891.252924:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789061891.252930:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130824960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.252960:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130824960:12345-0@lo:400:kworker.0 Request processed in 30us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061891.252965:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789061891.252976:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789061891.252982:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130824576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.253007:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130824576:12345-0@lo:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061891.253012:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789061891.253022:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789061891.253027:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130825088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.253051:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130825088:12345-0@lo:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061891.253057:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789061891.253082:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130823552 00000100:00100000:1.0:1789061891.253086:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130823552 00000100:00100000:1.0:1789061891.253117:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789061891.253123:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130823552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.253153:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130823552:12345-0@lo:400:kworker.0 Request processed in 30us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061891.253159:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789061891.253198:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130824064 00000100:00100000:1.0:1789061891.253203:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130824064 00000100:00100000:1.0:1789061891.253237:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789061891.253243:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130824064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.253277:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130824064:12345-0@lo:400:kworker.0 Request processed in 35us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061891.253283:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789061891.253330:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061891.253335:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061891.253365:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130823552:0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.253379:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130824064:0@lo:400:kworker.0 00010000:00080000:1.0:1789061891.253391:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676f100 x1875967130824576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061891.253402:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130824576:0@lo:400:kworker.0 00010000:00080000:1.0:1789061891.253411:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676f800 x1875967130825088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061891.253420:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130825088:0@lo:400:kworker.0 00010000:00080000:1.0:1789061891.253430:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676fb80 x1875967130824448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061891.253437:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130824448:0@lo:400:kworker.0 00010000:00080000:1.0:1789061891.253448:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676e300 x1875967130824960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061891.253454:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130824960:0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.256211:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130823936 00000100:00100000:2.0:1789061891.256232:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130823936 00000100:00100000:2.0:1789061891.256318:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789061891.256330:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130823936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061891.256466:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130823936:12345-0@lo:400:kworker.0 Request processed in 139us (4244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061891.256484:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789061891.256669:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130823936:0@lo:400:kworker.0 00000100:00100000:1.0:1789061891.768390:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130825216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061891.768487:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061891.768602:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130825216 00000100:00100000:1.0:1789061891.768638:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130825216 00000100:00100000:1.0:1789061891.768696:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789061891.768707:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130825216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789061891.768751:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789061891.768803:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130825216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061891.768811:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789061891.768899:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130825216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061891.769129:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789061891.769139:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130825344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061891.769175:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061891.769224:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130825344 00000100:00100000:0.0:1789061891.769229:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130825344 00000100:00100000:0.0:1789061891.769265:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789061891.769273:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c751ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130825344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789061891.769297:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061891.769333:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c751ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130825344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061891.769340:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1789061891.769422:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7518380 x1875967130825344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061891.769438:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130825344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061891.770182:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061891.770204:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130825472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061891.770247:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061891.770347:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130825472 00000100:00100000:2.0:1789061891.770355:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130825472 00000100:00100000:2.0:1789061891.770481:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789061891.770491:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130825472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061891.770507:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061891.770559:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130825472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (311us total) trans 0 rc 0/0 00010000:00080000:1.0:1789061891.770723:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6769500 x1875967130825472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061891.770741:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130825472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061891.770819:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:3.0:1789061891.881774:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061892.912833:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789061893.278155:0:12773:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789061893.278405:0:12773:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789061893.930006:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061894.313968:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130825600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789061894.314037:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061894.314196:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130825600 00000100:00100000:1.0:1789061894.314204:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130825600 00000100:00100000:1.0:1789061894.314255:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789061894.314265:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c751a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130825600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789061894.314294:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789061894.314342:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c751a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130825600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061894.314349:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789061894.314393:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130825600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061894.825846:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061894.825868:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130825728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061894.825947:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061894.826011:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130825728 00000100:00100000:2.0:1789061894.826018:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130825728 00000100:00100000:2.0:1789061894.826080:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789061894.826091:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130825728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789061894.826129:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061894.826183:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130825728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061894.826190:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1789061894.826232:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6769500 x1875967130825728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061894.826248:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130825728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061894.827705:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061894.827719:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130825856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061894.827765:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061894.827820:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130825856 00000100:00100000:2.0:1789061894.827825:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130825856 00000100:00100000:2.0:1789061894.827861:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789061894.827869:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130825856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061894.827884:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061894.827916:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130825856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061894.827922:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1789061894.827952:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676fb80 x1875967130825856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061894.827967:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130825856:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789061894.828666:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061894.921310:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061894.921358:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061894.921415:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061894.921524:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120262016 00000100:00100000:0.0:1789061894.921534:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120262016 00000100:00100000:0.0:1789061894.921598:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:0.0:1789061894.921639:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2389:x1875967120262016:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:0.0:1789061894.921679:0:8411:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6870 00000100:00080000:0.0:1789061894.921690:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9766c754c000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789061894.921706:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120261504 00000100:00100000:2.0:1789061894.921720:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120261504 00000001:00000004:0.0:1789061894.921741:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789061894.921802:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120261760 00000100:00100000:2.0:1789061894.921808:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120261760 00000100:00100000:2.0:1789061894.921850:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 159 00000100:00100000:0.0:1789061894.921912:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+2:2389:x1875967120262016:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 303us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061894.921921:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00010000:00010000:0.0:1789061894.921945:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061894.921999:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2390:x1875967120261504:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061894.921999:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 160 00000100:00100000:0.0:1789061894.922022:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120261760:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061894.922087:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2390:x1875967120261504:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 94us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061894.922097:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 159 00000100:00080000:1.0:1789061894.922256:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061894.922263:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061894.923052:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120261760:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1032us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061894.923062:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 160 00000100:00100000:2.0:1789061894.925485:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061894.925584:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061894.925634:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120262144 00000100:00100000:0.0:1789061894.925647:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120262144 00000100:00100000:2.0:1789061894.925657:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061894.925699:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061894.925733:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:0.0:1789061894.925744:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2389:x1875967120262144:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:0.0:1789061894.925769:0:8613:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6877 00000100:00080000:0.0:1789061894.925779:0:8613:0:(import.c:65:import_set_state_nolock()) ffff9766c7548800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789061894.925825:0:8613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789061894.925972:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+2:2389:x1875967120262144:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 228us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061894.925980:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00010000:00010000:0.0:1789061894.926003:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061894.926028:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120261632 00000100:00100000:0.0:1789061894.926032:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120261632 00000100:00100000:0.0:1789061894.926075:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 161 00000100:00100000:2.0:1789061894.926076:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120261888 00000100:00100000:2.0:1789061894.926087:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120261888 00000100:00100000:0.0:1789061894.926104:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120261632:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061894.926145:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120261632:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 42us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061894.926170:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 161 00000100:00100000:0.0:1789061894.926196:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 162 00000100:00100000:0.0:1789061894.926205:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120261888:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061894.926230:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120261888:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061894.926236:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 162 00000100:00080000:2.0:1789061894.926308:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789061894.926314:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789061894.927055:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120261376 00000100:00100000:0.0:1789061894.927063:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120261376 00000100:00100000:0.0:1789061894.927099:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 307 00000100:00100000:0.0:1789061894.927107:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120261376:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061894.927215:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120261376:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 108us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061894.927222:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 307 00010000:00010000:3.0:1789061894.954935:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789061895.366297:0:12870:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789061895.366788:0:12870:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789061895.977771:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061896.361814:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130825984:0@lo:400:kworker.0 00000100:00100000:3.0:1789061896.361916:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061896.362027:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130825984 00000100:00100000:0.0:1789061896.362036:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130825984 00000100:00100000:0.0:1789061896.362100:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789061896.362112:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130825984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061896.363442:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130826112:0@lo:400:kworker.0 00000100:00100000:1.0:1789061896.363509:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061896.363572:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130826112 00000100:00100000:1.0:1789061896.363579:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130826112 00000100:00100000:1.0:1789061896.363650:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789061896.363659:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130826112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061896.363709:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130826112:12345-0@lo:400:kworker.0 Request processed in 51us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061896.363718:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789061896.363774:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130826112:0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.364068:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130825984:12345-0@lo:400:kworker.0 Request processed in 1956us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061896.364078:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789061896.366541:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061896.366568:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130826240:0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.366675:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061896.366716:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875967130826368:0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.366744:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061896.366787:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130826240 00000100:00100000:0.0:1789061896.366795:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130826240 00000100:00100000:0.0:1789061896.366848:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789061896.366849:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130826752:0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.366857:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c751bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130826240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.366910:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c751bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130826240:12345-0@lo:400:kworker.0 Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061896.366916:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789061896.366944:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130826368 00000100:00100000:0.0:1789061896.366948:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130826368 00000100:00100000:2.0:1789061896.366951:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061896.366974:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130827264:0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.366980:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130826752 00000100:00100000:0.0:1789061896.366983:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130826752 00000100:00100000:2.0:1789061896.366998:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061896.367014:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130827264 00000100:00100000:2.0:1789061896.367016:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789061896.367017:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130827264 00000100:00100000:2.0:1789061896.367021:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130826880:0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.367033:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789061896.367039:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875967130826368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.367045:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061896.367065:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130827392:0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.367069:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875967130826368:12345-0@lo:400:kworker.0 Request processed in 30us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061896.367074:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789061896.367083:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061896.367087:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789061896.367093:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130826752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.367111:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789061896.367119:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130827264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.367124:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130826752:12345-0@lo:400:kworker.0 Request processed in 32us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061896.367129:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1789061896.367150:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789061896.367169:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130827264:12345-0@lo:400:kworker.0 Request processed in 52us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061896.367175:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789061896.367206:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130826880 00000100:00100000:2.0:1789061896.367210:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130826880 00000100:00100000:2.0:1789061896.367240:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130827392 00000100:00100000:2.0:1789061896.367243:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130827392 00000100:00100000:2.0:1789061896.367262:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789061896.367269:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130826880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.367425:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130826880:12345-0@lo:400:kworker.0 Request processed in 155us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061896.367432:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789061896.367447:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789061896.367454:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130827392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.367486:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130827392:12345-0@lo:400:kworker.0 Request processed in 33us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061896.367492:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789061896.367519:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130826624:0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.367785:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061896.367810:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130827136:0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.367832:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061896.367850:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789061896.367856:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130826496:0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.367948:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061896.367971:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130827008:0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.367994:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061896.368009:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130827520:0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.368030:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061896.368054:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130827008 00000100:00100000:2.0:1789061896.368067:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130827008 00000100:00100000:2.0:1789061896.368091:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130827520 00000100:00100000:2.0:1789061896.368093:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130827520 00000100:00100000:2.0:1789061896.368105:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789061896.368111:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130827008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.368167:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130827008:12345-0@lo:400:kworker.0 Request processed in 55us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061896.368173:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789061896.368186:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789061896.368193:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130827520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.368219:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130827520:12345-0@lo:400:kworker.0 Request processed in 27us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061896.368225:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789061896.368240:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130826624 00000100:00100000:2.0:1789061896.368243:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130826624 00000100:00100000:2.0:1789061896.368265:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130827136 00000100:00100000:2.0:1789061896.368268:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130827136 00000100:00100000:2.0:1789061896.368283:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789061896.368289:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130826624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.368331:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130826624:12345-0@lo:400:kworker.0 Request processed in 42us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061896.368337:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789061896.368350:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789061896.368356:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130827136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.368382:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130827136:12345-0@lo:400:kworker.0 Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061896.368388:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00080000:2.0:1789061896.368438:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b7480 x1875967130827008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061896.368454:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130827008:0@lo:400:kworker.0 00010000:00080000:2.0:1789061896.368466:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7507b80 x1875967130827520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061896.368475:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130827520:0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.368485:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130826624:0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.368494:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130827136:0@lo:400:kworker.0 00000100:00100000:3.0:1789061896.369085:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130825984:0@lo:400:kworker.0 00000100:00080000:0.0:1789061896.369258:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061896.369262:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061896.369264:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061896.369293:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130826496 00000100:00100000:2.0:1789061896.369967:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875967130826368:0@lo:400:kworker.0 00000100:00100000:2.0:1789061896.369982:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130826240:0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.370042:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130826496 00000100:00100000:0.0:1789061896.370102:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789061896.370111:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130826496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.370266:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130826496:12345-0@lo:400:kworker.0 Request processed in 156us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061896.370274:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:0.0:1789061896.370331:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b4380 x1875967130826880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061896.370342:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130826880:0@lo:400:kworker.0 00010000:00080000:0.0:1789061896.370354:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7504380 x1875967130827392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061896.370361:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130827392:0@lo:400:kworker.0 00010000:00080000:0.0:1789061896.370372:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b5f80 x1875967130826752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061896.370379:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130826752:0@lo:400:kworker.0 00010000:00080000:0.0:1789061896.370391:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7505c00 x1875967130827264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061896.370398:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130827264:0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.370427:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130826496:0@lo:400:kworker.0 00000100:00100000:0.0:1789061896.878520:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130827648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061896.878843:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061896.879482:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130827904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061896.879515:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061896.879545:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061896.879551:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130827776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061896.879573:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061896.879620:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130827648 00000100:00100000:1.0:1789061896.879629:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130827648 00000100:00100000:1.0:1789061896.879668:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130827776 00000100:00100000:1.0:1789061896.879671:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130827776 00000100:00100000:1.0:1789061896.879687:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789061896.879696:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c751a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130827648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789061896.879723:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061896.879766:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c751a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130827648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061896.879780:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789061896.879797:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789061896.879803:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130827776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061896.879814:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061896.879844:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130827776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061896.879849:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1789061896.879883:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c56ffb80 x1875967130827776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061896.879900:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130827776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061896.879954:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130827904 00000100:00100000:1.0:1789061896.879957:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130827904 00000100:00100000:1.0:1789061896.879983:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789061896.879989:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130827904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789061896.880009:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789061896.880055:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130827904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061896.880061:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789061896.880093:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130827904:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1789061896.880124:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7518a80 x1875967130827648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061896.880136:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130827648:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789061897.003110:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061898.025889:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789061898.919405:0:13015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789061899.049844:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061899.433989:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130828032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061899.434251:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061899.434473:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130828032 00000100:00100000:2.0:1789061899.434484:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130828032 00000100:00100000:2.0:1789061899.434541:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789061899.434552:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130828032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789061899.434595:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789061899.434690:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130828032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061899.434698:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789061899.434870:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130828032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061899.945791:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061899.945814:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130828160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061899.945880:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061899.945920:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130828160 00000100:00100000:0.0:1789061899.945929:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130828160 00000100:00100000:0.0:1789061899.945996:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789061899.946006:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130828160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061899.946037:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061899.946043:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130828288:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789061899.950681:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061899.952415:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061899.952541:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130828288 00000100:00100000:2.0:1789061899.952560:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130828288 00000100:00100000:2.0:1789061899.952627:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789061899.952636:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130828288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789061899.952658:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061899.952700:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130828288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061899.952707:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789061899.952766:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061899.952793:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c56ffb80 x1875967130828288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061899.952812:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130828288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789061899.954057:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130828160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8047us (8171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061899.954067:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1789061899.954138:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd43dc00 x1875967130828160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061899.954157:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130828160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061900.036368:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061900.036406:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061900.036435:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061900.036464:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061900.036489:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061900.036524:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120262528 00000100:00100000:2.0:1789061900.036533:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120262528 00000100:00100000:2.0:1789061900.036586:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120262784 00000100:00100000:2.0:1789061900.036589:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120262784 00000100:00100000:2.0:1789061900.036602:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120262400 00000100:00100000:2.0:1789061900.036628:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120262400 00000100:00100000:2.0:1789061900.036643:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120262656 00000100:00100000:2.0:1789061900.036645:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120262656 00000100:00100000:2.0:1789061900.036660:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 169 00000100:00100000:2.0:1789061900.036669:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120262528:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061900.036734:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120262528:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 66us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061900.036741:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 169 00000100:00100000:2.0:1789061900.036767:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 170 00000100:00100000:2.0:1789061900.036773:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120262784:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061900.036797:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120262784:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061900.036803:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 170 00000100:00100000:2.0:1789061900.036813:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 171 00000100:00100000:2.0:1789061900.036819:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120262400:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061900.036839:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120262400:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061900.036844:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 171 00000100:00100000:2.0:1789061900.036856:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00100000:2.0:1789061900.036861:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120262656:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061900.036881:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120262656:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061900.036886:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00080000:2.0:1789061900.036906:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789061900.036910:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789061900.037366:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120262272 00000100:00100000:0.0:1789061900.037371:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120262272 00000100:00100000:0.0:1789061900.037406:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 309 00000100:00100000:0.0:1789061900.037414:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2393:x1875967120262272:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061900.037453:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2393:x1875967120262272:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 39us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061900.037459:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 309 00010000:00010000:0.0:1789061900.073825:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789061900.975160:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a8bf6189-9e16-4d60-bea6-060afd49ee07 00000020:00000080:1.0:1789061900.975173:0:8406:0:(genops.c:885:class_export_put()) final put ffff9766c754b800/a8bf6189-9e16-4d60-bea6-060afd49ee07 00000001:00100000:0.0:1789061900.975249:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a8bf6189-9e16-4d60-bea6-060afd49ee07 00000020:00000080:0.0:1789061900.975253:0:9490:0:(genops.c:885:class_export_put()) final put ffff9766c754f000/a8bf6189-9e16-4d60-bea6-060afd49ee07 00000020:00000080:1.0:1789061900.977852:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c754b800/a8bf6189-9e16-4d60-bea6-060afd49ee07 for lustre-OST0000 00000020:00000080:1.0:1789061900.977910:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c754c000 for lustre-OST0000 00000020:00000080:1.0:1789061900.978051:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c754f000/a8bf6189-9e16-4d60-bea6-060afd49ee07 for lustre-OST0001 00000020:00000080:1.0:1789061900.978071:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c7548800 for lustre-OST0001 00010000:00010000:3.0:1789061901.102709:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061901.495822:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130828416:0@lo:400:kworker.0 00000100:00100000:1.0:1789061901.495903:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061901.496034:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130828416 00000100:00100000:0.0:1789061901.496042:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130828416 00000100:00100000:0.0:1789061901.496094:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789061901.496104:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130828416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061901.503859:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130828800:0@lo:400:kworker.0 00000100:00100000:2.0:1789061901.504007:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061901.504673:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130828800 00000100:00100000:2.0:1789061901.504681:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130828800 00000100:00100000:2.0:1789061901.504941:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789061901.504951:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130828800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061901.505098:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130828800:12345-0@lo:400:kworker.0 Request processed in 147us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061901.505131:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789061901.505183:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130828416:12345-0@lo:400:kworker.0 Request processed in 9078us (9278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061901.505184:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130828800:0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.505209:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789061901.505385:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130828672:0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.505423:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061901.505928:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061901.505936:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130828544:0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.505966:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061901.505999:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130828544 00000100:00100000:0.0:1789061901.506005:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130828544 00000100:00100000:0.0:1789061901.506034:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789061901.506041:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130828544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.506077:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130828544:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061901.506083:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789061901.506136:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130828544:0@lo:400:kworker.0 00000100:00100000:3.0:1789061901.507269:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130829056:0@lo:400:kworker.0 00000100:00100000:3.0:1789061901.507347:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061901.507408:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130829184:0@lo:400:kworker.0 00000100:00100000:3.0:1789061901.507433:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061901.507490:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130829568:0@lo:400:kworker.0 00000100:00100000:3.0:1789061901.507524:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061901.507571:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130829696:0@lo:400:kworker.0 00000100:00100000:3.0:1789061901.507594:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061901.507653:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130829056 00000100:00100000:3.0:1789061901.507659:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130829056 00000100:00100000:3.0:1789061901.507703:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130829184 00000100:00100000:3.0:1789061901.507706:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130829184 00000100:00100000:0.0:1789061901.508145:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130829312:0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.508180:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061901.508204:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789061901.508210:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130828928:0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.508244:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061901.508282:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130829568 00000100:00100000:3.0:1789061901.508287:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130829568 00000100:00100000:3.0:1789061901.508305:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130829696 00000100:00100000:3.0:1789061901.508307:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130829696 00000100:00100000:3.0:1789061901.508323:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789061901.508331:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130829056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061901.508381:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130829056:12345-0@lo:400:kworker.0 Request processed in 50us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061901.508387:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789061901.508404:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789061901.508410:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130829184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061901.508440:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130829184:12345-0@lo:400:kworker.0 Request processed in 30us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061901.508446:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789061901.508458:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789061901.508464:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130829568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061901.508511:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130829568:12345-0@lo:400:kworker.0 Request processed in 47us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061901.508518:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789061901.508532:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789061901.508538:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130829696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061901.508565:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130829696:12345-0@lo:400:kworker.0 Request processed in 27us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061901.508570:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789061901.508666:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130829568:0@lo:400:kworker.0 00000100:00100000:3.0:1789061901.508681:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130829056:0@lo:400:kworker.0 00010000:00080000:3.0:1789061901.508714:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f4573800 x1875967130829696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061901.509669:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130829696:0@lo:400:kworker.0 00010000:00080000:3.0:1789061901.509692:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676d880 x1875967130829184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061901.509700:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130829184:0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.510175:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130829440:0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.510224:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061901.510262:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130829824:0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.510282:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061901.510298:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789061901.510326:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130829952:0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.510351:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061901.510379:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130829312 00000100:00100000:0.0:1789061901.510385:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130829312 00000100:00100000:0.0:1789061901.510417:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130829440 00000100:00100000:0.0:1789061901.510420:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130829440 00000100:00100000:0.0:1789061901.510431:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130829824 00000100:00100000:0.0:1789061901.510433:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130829824 00000100:00100000:0.0:1789061901.510443:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130829952 00000100:00100000:0.0:1789061901.510446:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130829952 00000100:00100000:0.0:1789061901.510458:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789061901.510465:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130829312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.510509:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130829312:12345-0@lo:400:kworker.0 Request processed in 43us (2328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061901.510516:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789061901.510534:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789061901.510540:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130829440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.510566:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130829440:12345-0@lo:400:kworker.0 Request processed in 27us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061901.510572:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789061901.510584:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789061901.510589:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130829824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.510628:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130829824:12345-0@lo:400:kworker.0 Request processed in 39us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061901.510634:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789061901.510644:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789061901.510650:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130829952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061901.510682:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130829952:12345-0@lo:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061901.510688:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1789061901.510716:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f4572d80 x1875967130829952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061901.510726:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130829952:0@lo:400:kworker.0 00010000:00080000:0.0:1789061901.510735:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f4573800 x1875967130829824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061901.510742:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130829824:0@lo:400:kworker.0 00010000:00080000:0.0:1789061901.510750:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd5c6300 x1875967130829440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061901.510758:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130829440:0@lo:400:kworker.0 00010000:00080000:0.0:1789061901.510766:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd5c5880 x1875967130829312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061901.510773:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130829312:0@lo:400:kworker.0 00000100:00100000:1.0:1789061901.510906:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130828416:0@lo:400:kworker.0 00000100:00100000:2.0:1789061901.511426:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130828672 00000100:00100000:2.0:1789061901.511432:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130828672 00000100:00100000:2.0:1789061901.511472:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130828928 00000100:00100000:2.0:1789061901.511475:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130828928 00000100:00100000:2.0:1789061901.511490:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789061901.511496:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130828672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061901.511541:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130828672:12345-0@lo:400:kworker.0 Request processed in 45us (6118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061901.511546:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789061901.511559:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789061901.511564:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130828928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061901.511592:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130828928:12345-0@lo:400:kworker.0 Request processed in 27us (3347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061901.511597:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1789061901.511638:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061901.511643:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061901.511645:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789061901.511648:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061901.511676:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130828672:0@lo:400:kworker.0 00000100:00100000:2.0:1789061901.511701:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130828928:0@lo:400:kworker.0 00000020:00000080:0.0:1789061901.918787:0:13162:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea3350720 20000000:00000080:0.0:1789061901.918804:0:13162:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9766c5706800 uarg=0000000000000000 20000000:01000000:0.0:1789061901.918844:0:13162:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789061901.918850:0:13162:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789061901.918854:0:13162:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789061901.919677:0:13163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789061901.919856:0:13162:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789061901.931429:0:13162:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789061901.931468:0:13162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.932882:0:13162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc680e expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.932890:0:13162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6823 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc681c expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.932897:0:13162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c1483600/0x2774d8f311dc6831 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc682a expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.932904:0:13162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc683f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6838 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.932914:0:13162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc6846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b75b expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.932921:0:13162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc685b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b79a expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.932927:0:13162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.932973:0:13162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc685b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b79a expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.932989:0:13162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc685b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b79a expref: 12 pid: 6488 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061901.933002:0:13162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875967130830080:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061901.933123:0:13162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc6846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b75b expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.933145:0:13162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc6846 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b75b expref: 12 pid: 6491 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061901.933154:0:13162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875967130830208:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061901.933191:0:13162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc683f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6838 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.933200:0:13162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc683f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6838 expref: 23 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061901.933210:0:13162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875967130830336:0@lo:104: 00000100:00100000:0.0:1789061901.933249:0:13162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061901.933271:0:13162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c1483600/0x2774d8f311dc6831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc682a expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.933278:0:13162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c1483600/0x2774d8f311dc6831 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc682a expref: 23 pid: 6490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061901.933285:0:13162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875967130830464:0@lo:104: 00000100:00100000:0.0:1789061901.933302:0:13162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061901.933330:0:13162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc681c expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.933339:0:13162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc681c expref: 23 pid: 6490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061901.933347:0:13162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875967130830592:0@lo:104: 00000100:00100000:3.0:1789061901.933351:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130830336 00000100:00100000:3.0:1789061901.933361:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130830336 00000100:00100000:0.0:1789061901.933368:0:13162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061901.933401:0:13162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc680e expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061901.933402:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130830464 00000100:00100000:3.0:1789061901.933408:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130830464 00010000:00010000:0.0:1789061901.933416:0:13162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6815 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc680e expref: 23 pid: 6491 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061901.933425:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130830592 00000100:00100000:0.0:1789061901.933428:0:13162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6729f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875967130830720:0@lo:104: 00000100:00100000:3.0:1789061901.933430:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130830592 00000100:00100000:3.0:1789061901.933454:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789061901.933459:0:13162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061901.933467:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:13162:x1875967130830336:12345-0@lo:104: 00000100:00100000:0.0:1789061901.933471:0:13162:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd4350c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789061901.933489:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc683f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.933552:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789061901.933568:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:13162:x1875967130830336:12345-0@lo:104: Request processed in 97us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061901.933576:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789061901.933593:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130830720 00000100:00100000:3.0:1789061901.933596:0:6478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130830720 00000100:00100000:0.0:1789061901.933703:0:13162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875967130830336:0@lo:104: 00000100:00100000:3.0:1789061901.933739:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789061901.933747:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4504000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:13162:x1875967130830464:12345-0@lo:104: 00010000:00010000:3.0:1789061901.933755:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6831 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.933844:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789061901.933848:0:13162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875967130830464:0@lo:104: 00000100:00100000:3.0:1789061901.933854:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4504000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:13162:x1875967130830464:12345-0@lo:104: Request processed in 106us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061901.933862:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789061901.933892:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789061901.933903:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:13162:x1875967130830592:12345-0@lo:104: 00010000:00010000:3.0:1789061901.933911:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6823 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061901.933937:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789061901.933951:0:6479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:13162:x1875967130830720:12345-0@lo:104: 00010000:00010000:3.0:1789061901.933958:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789061901.933961:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6815 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061901.933967:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:13162:x1875967130830592:12345-0@lo:104: Request processed in 68us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061901.933979:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:3.0:1789061901.934001:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789061901.934012:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1789061901.934015:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc683f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061901.934020:0:6479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:13162:x1875967130830720:12345-0@lo:104: Request processed in 73us (559us total) trans 0 rc 0/0 00010000:00010000:3.0:1789061901.934031:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483200 already unused, calling callback (ffffffffc14eec20) 00000100:00100000:1.0:1789061901.934033:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 10000000:00010000:3.0:1789061901.934038:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc683f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934048:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc683f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061901.934056:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc683f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.934058:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789061901.934065:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6831 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061901.934067:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789061901.934081:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c74da400 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789061901.934085:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6831 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.934093:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6831 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934098:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc683f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061901.934100:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6831 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934124:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1789061901.934130:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789061901.934148:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc683f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.934149:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6831 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.934167:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061901.934170:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc6838 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc683f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.934178:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6831 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934186:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789061901.934187:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c74da400/0x2774d8f311dc682a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6831 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934190:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6823 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934203:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c74dba00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789061901.934207:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6823 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.934207:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061901.934214:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc6815 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.934222:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c74daa00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789061901.934228:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc6815 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934234:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6823 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061901.934242:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6823 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061901.934258:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789061901.934259:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc6815 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061901.934268:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc6815 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061901.934274:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789061901.934287:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6823 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.934294:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6815 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934296:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061901.934305:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061901.934316:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6823 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934324:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c74dba00/0x2774d8f311dc681c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6823 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934334:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061901.934336:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061901.934338:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061901.934346:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061901.934358:0:13162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875967130830592:0@lo:104: 00000100:00100000:3.0:1789061901.934366:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130830848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789061901.934370:0:13162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6729f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875967130830720:0@lo:104: 00000100:00100000:3.0:1789061901.934400:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061901.934438:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061901.934444:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c56ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130830976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061901.934464:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061901.934491:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130830848 00000100:00100000:3.0:1789061901.934495:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130830848 00010000:00010000:3.0:1789061901.934514:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc683f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6838 expref: 24 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061901.934541:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130830976 00000100:00100000:3.0:1789061901.934544:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130830976 00010000:00010000:3.0:1789061901.934556:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c1483600/0x2774d8f311dc6831 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc682a expref: 25 pid: 6490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061901.934574:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789061901.934581:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+25:3620:x1875967130830848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789061901.934591:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061901.934596:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc683f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6838 expref: 25 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934625:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc683f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6838 expref: 25 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934638:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc683f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6838 expref: 25 pid: 6488 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934649:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061901.934677:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130830848:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061901.934684:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789061901.934697:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789061901.934703:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:3620:x1875967130830976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789061901.934711:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061901.934715:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c1483600/0x2774d8f311dc6831 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc682a expref: 23 pid: 6490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934723:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c1483600/0x2774d8f311dc6831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc682a expref: 23 pid: 6490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934740:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1483600/0x2774d8f311dc6831 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc682a expref: 23 pid: 6490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.934750:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061901.934773:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:3620:x1875967130830976:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061901.934779:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789061901.934805:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c56ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130830976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061901.934814:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130830848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061901.936591:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130831104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061901.936730:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061901.937444:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061901.937452:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130831232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061901.937485:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789061901.938573:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6815 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.938588:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c74daa00/0x2774d8f311dc680e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc6815 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.938740:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061901.938742:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061901.938745:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061901.940065:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130831104 00000100:00100000:0.0:1789061901.940075:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130831104 00000100:00100000:3.0:1789061901.940101:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130831232 00000100:00100000:3.0:1789061901.940107:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130831232 00010000:00010000:0.0:1789061901.940126:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc681c expref: 23 pid: 6490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.940142:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6815 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc680e expref: 23 pid: 6491 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061901.940157:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789061901.940169:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4573b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:3622:x1875967130831104:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061901.940178:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1789061901.940185:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789061901.940190:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4571f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:3622:x1875967130831232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789061901.940194:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6823 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc681c expref: 23 pid: 6490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.940203:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061901.940210:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc681c expref: 23 pid: 6490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.940211:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6815 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc680e expref: 23 pid: 6491 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.940233:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc680e expref: 23 pid: 6491 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.940263:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c74da200/0x2774d8f311dc6823 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc681c expref: 23 pid: 6490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061901.940344:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6815 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc680e expref: 22 pid: 6491 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.940345:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061901.940358:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061901.940413:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4571f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3622:x1875967130831232:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (2926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061901.940418:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4573b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3622:x1875967130831104:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061901.940426:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789061901.940434:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789061901.940473:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130831232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061901.940484:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130831104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061901.940829:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061901.940901:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061901.940941:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120262912 00000100:00100000:1.0:1789061901.940947:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120262912 00010000:00010000:1.0:1789061901.940966:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc685b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b79a expref: 13 pid: 6488 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061901.940990:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120263040 00000100:00100000:1.0:1789061901.940994:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120263040 00000100:00100000:2.0:1789061901.941002:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00010000:00010000:1.0:1789061901.941008:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc6846 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b75b expref: 14 pid: 6491 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061901.941023:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21c8093b-edf9-482d-a900-a6298c53147f+14:2393:x1875967120262912:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061901.941043:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789061901.941045:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00010000:00010000:2.0:1789061901.941052:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc685b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b79a expref: 14 pid: 6488 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061901.941058:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21c8093b-edf9-482d-a900-a6298c53147f+14:2392:x1875967120263040:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061901.941070:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc685b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b79a expref: 14 pid: 6488 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061901.941081:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061901.941132:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21c8093b-edf9-482d-a900-a6298c53147f+14:2393:x1875967120262912:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 115us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061901.941139:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00010000:00010000:1.0:1789061901.941295:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061901.941301:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc6846 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b75b expref: 13 pid: 6491 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.941311:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc6846 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b75b expref: 13 pid: 6491 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.941323:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.941332:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.941347:0:9499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.941355:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.941362:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.941370:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.941376:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031400 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789061901.941380:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.941406:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.941415:0:13162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc685b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b79a expref: 13 pid: 6488 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061901.941419:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061901.941431:0:13162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875967130830080:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061901.941436:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061901.941461:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21c8093b-edf9-482d-a900-a6298c53147f+12:2392:x1875967120263040:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 407us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061901.941469:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00010000:00010000:0.0:1789061901.941551:0:13162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0030c00/0x2774d8f311dc6846 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b75b expref: 11 pid: 6491 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061901.941563:0:13162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13162:1875967130830208:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061901.941593:0:13162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.941602:0:13162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.941811:0:13162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061901.941817:0:13162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031400/0x2774d8f311dc687e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061901.995225:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130831360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061901.995288:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061901.995359:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130831360 00000100:00100000:1.0:1789061901.995365:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130831360 00000100:00100000:1.0:1789061901.995405:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789061901.995414:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130831360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061901.995441:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061901.995483:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130831360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061901.995489:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1789061901.995544:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd344000 x1875967130831360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061901.995562:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130831360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061901.995672:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130831488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061901.995703:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061901.996032:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130831488 00000100:00100000:2.0:1789061901.996037:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130831488 00000100:00100000:2.0:1789061901.996066:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789061901.996073:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130831488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789061901.996095:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789061901.996143:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130831488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061901.996149:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789061901.996165:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061901.996173:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130831616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789061901.996199:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061901.996244:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130831616 00000100:00100000:2.0:1789061901.996248:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130831616 00000100:00100000:2.0:1789061901.996271:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789061901.996277:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130831616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789061901.996288:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061901.996329:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130831616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061901.996335:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1789061901.996360:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd43fb80 x1875967130831616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061901.996373:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130831616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061901.996448:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130831488:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789061902.122816:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061903.145710:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061903.559071:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061903.559118:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120263168 00000100:00100000:3.0:1789061903.559128:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120263168 00000100:00100000:3.0:1789061903.559177:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 311 00000100:00100000:3.0:1789061903.559187:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+11:6165:x1875967120263168:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061903.559204:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061903.559223:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c3799400/0x2774d8f311dc6885 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b7cb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.559249:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c3799400/0x2774d8f311dc6885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7cb expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.559275:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c3799400/0x2774d8f311dc6885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7cb expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.559285:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3799400, rc 0) 00000100:00100000:3.0:1789061903.559342:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+12:6165:x1875967120263168:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 156us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061903.560968:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 311 00000100:00100000:3.0:1789061903.562530:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061903.562561:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120263296 00000100:00100000:3.0:1789061903.562568:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120263296 00000100:00100000:3.0:1789061903.562629:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 312 00000100:00100000:3.0:1789061903.562640:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+12:6165:x1875967120263296:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061903.562971:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+12:6165:x1875967120263296:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 333us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061903.562979:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 312 00000100:00100000:0.0:1789061903.575125:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061903.575188:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120263424 00000100:00100000:3.0:1789061903.575198:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120263424 00000100:00100000:3.0:1789061903.575254:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 313 00000100:00100000:3.0:1789061903.575264:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+12:6165:x1875967120263424:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061903.575412:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+12:6165:x1875967120263424:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 149us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061903.575420:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 313 00000100:00100000:3.0:1789061903.591747:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061903.591856:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120263552 00000100:00100000:1.0:1789061903.591866:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120263552 00000100:00100000:1.0:1789061903.591925:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 314 00000100:00100000:1.0:1789061903.591935:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+12:6165:x1875967120263552:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061903.591952:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061903.591969:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc688c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b7d2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061903.591996:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc688c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7d2 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061903.592007:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc688c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7d2 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061903.592016:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47ba00, rc 0) 00000100:00100000:1.0:1789061903.592406:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:6165:x1875967120263552:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 471us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061903.592413:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 314 10000000:01000000:3.0:1789061903.597276:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789061903.597283:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fd65c800 from 7 10000000:01000000:3.0:1789061903.597294:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789061903.597337:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.597350:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.597362:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061903.597387:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130831744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789061903.597453:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061903.597511:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061903.597553:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130831744 00000100:00100000:3.0:1789061903.597560:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130831744 00000100:00100000:3.0:1789061903.597628:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789061903.597640:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130831744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061903.597653:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061903.597666:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c3799200/0x2774d8f311dc689a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6893 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.597688:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c3799200/0x2774d8f311dc689a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6893 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.597699:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c3799200/0x2774d8f311dc689a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6893 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.597707:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3799200, rc 0) 00000100:00100000:3.0:1789061903.597752:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130831744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061903.597771:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789061903.597844:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130831744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061903.597858:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc689a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.597867:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc689a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061903.597924:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130831872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061903.597957:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061903.597979:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727240 going to sleep for 11 seconds 00000100:00100000:1.0:1789061903.604480:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130831872 00000100:00100000:1.0:1789061903.604494:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130831872 00000100:00100000:1.0:1789061903.604560:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789061903.604570:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130831872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061903.604881:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130831872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (6925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061903.604890:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789061903.605845:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130831872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061903.605901:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061903.605959:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061903.605992:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061903.606009:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130832000 00000100:00100000:3.0:1789061903.606014:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130832000 00000100:00100000:3.0:1789061903.606052:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789061903.606060:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130832000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061903.606162:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130832000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061903.606170:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789061903.606217:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789061903.607667:0:13253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:2.0:1789061903.607886:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000020:01000000:2.0:1789061903.607916:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789061903.607946:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061903.607959:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc689a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.607970:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc689a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061903.607980:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789061903.607983:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fd12c000 from 7 10000000:01000000:2.0:1789061903.607985:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061903.608020:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.608028:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.608037:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061903.608056:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.608096:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061903.608146:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d0192f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789061903.608197:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120263680 00000100:00100000:3.0:1789061903.608203:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120263680 00000100:00100000:3.0:1789061903.608244:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130832128 00000100:00100000:3.0:1789061903.608247:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130832128 00000100:00100000:3.0:1789061903.608269:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 318 00000100:00100000:3.0:1789061903.608279:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:6165:x1875967120263680:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.608418:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789061903.608428:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130832128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061903.608437:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061903.608448:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c1483200/0x2774d8f311dc68a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc68a1 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.608469:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1483200/0x2774d8f311dc68a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc68a1 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061903.608630:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:6165:x1875967120263680:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 328us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061903.608639:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 318 00010000:00010000:2.0:1789061903.608705:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c1483200/0x2774d8f311dc68a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc68a1 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.608716:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c1483200, rc 0) 00000100:00100000:2.0:1789061903.608754:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130832128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 328us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061903.608760:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789061903.610649:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061903.610673:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc68a8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.610686:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc68a8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061903.610764:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061903.610818:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061903.610862:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c77270c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061903.611335:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130832256 00000100:00100000:2.0:1789061903.611343:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130832256 00000100:00100000:2.0:1789061903.611385:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789061903.611396:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130832256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.611525:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130832256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061903.611533:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789061903.611576:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4572a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.611626:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.611665:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061903.611693:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d0192840 going to sleep for 11 seconds 00000100:00100000:2.0:1789061903.611706:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130832384 00000100:00100000:2.0:1789061903.611710:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130832384 00000100:00100000:2.0:1789061903.611737:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789061903.611745:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130832384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.611827:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130832384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061903.611834:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789061903.611872:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789061903.612510:0:13254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789061903.612564:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789061903.612586:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061903.612594:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc68a8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.612626:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc68a8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061903.612638:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789061903.612641:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fb057800 from 7 10000000:01000000:2.0:1789061903.612644:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061903.612667:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.612674:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.612683:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061903.612710:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.612745:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061903.612769:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d01929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061903.612783:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130832512 00000100:00100000:2.0:1789061903.612788:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130832512 00000100:00100000:2.0:1789061903.612814:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789061903.612821:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130832512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061903.612830:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061903.612842:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c1483600/0x2774d8f311dc68b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc68af expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.612861:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1483600/0x2774d8f311dc68b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc68af expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.612871:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c1483600/0x2774d8f311dc68b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc68af expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.612879:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c1483600, rc 0) 00000100:00100000:2.0:1789061903.612909:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130832512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061903.612915:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789061903.612951:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061903.612963:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc68b6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.612972:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc68b6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061903.613020:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.613042:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061903.613055:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d01929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061903.613066:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130832640 00000100:00100000:2.0:1789061903.613069:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130832640 00000100:00100000:2.0:1789061903.613088:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789061903.613094:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130832640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.613187:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130832640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061903.613193:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789061903.613223:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.613246:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.613281:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061903.613295:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d01929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061903.613306:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130832768 00000100:00100000:2.0:1789061903.613310:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130832768 00000100:00100000:2.0:1789061903.613332:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789061903.613339:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130832768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.613408:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130832768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061903.613414:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789061903.613449:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061903.614387:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061903.614443:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120263808 00000100:00100000:2.0:1789061903.614453:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120263808 00000100:00100000:2.0:1789061903.614493:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 325 00000100:00100000:2.0:1789061903.614501:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:6165:x1875967120263808:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.614589:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:6165:x1875967120263808:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061903.614597:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 325 00000040:00080000:3.0:1789061903.616580:0:13255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789061903.616904:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789061903.616929:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061903.616939:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc68b6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.616951:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc68b6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061903.616960:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789061903.616963:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767c3163000 from 7 10000000:01000000:2.0:1789061903.616966:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061903.617073:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.617082:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.617094:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061903.617126:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.617185:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061903.617427:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d01929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061903.617475:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130832896 00000100:00100000:3.0:1789061903.617544:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130832896 00000100:00100000:3.0:1789061903.617590:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789061903.617598:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130832896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061903.618171:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061903.618187:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c3798200/0x2774d8f311dc68c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc68bd expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.618223:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c3798200/0x2774d8f311dc68c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc68bd expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.618233:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c3798200/0x2774d8f311dc68c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc68bd expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061903.618242:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3798200, rc 0) 00000100:00100000:3.0:1789061903.618298:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130832896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 700us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061903.618307:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789061903.618414:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130832896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061903.618431:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc68c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.618442:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc68c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061903.618574:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130833024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.618602:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061903.618778:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130833024 00000100:00100000:0.0:1789061903.618784:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130833024 00000100:00100000:0.0:1789061903.618823:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789061903.618830:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130833024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061903.618925:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130833024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061903.618932:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789061903.619077:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d01929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061903.619093:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130833024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061903.619137:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4571180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130833152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061903.619176:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061903.619201:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c77276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061903.619243:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130833152 00000100:00100000:2.0:1789061903.619248:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130833152 00000100:00100000:2.0:1789061903.619277:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789061903.619285:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130833152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061903.619376:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130833152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061903.619384:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789061903.619559:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4571180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130833152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789061903.623153:0:13256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789061903.623316:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789061903.623344:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061903.623356:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc68c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061903.623367:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc68c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061904.170213:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061904.557268:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061904.557289:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130833280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789061904.557351:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061904.557418:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130833280 00000100:00100000:1.0:1789061904.557431:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130833280 00000100:00100000:1.0:1789061904.557477:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789061904.557485:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130833280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789061904.557515:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789061904.557558:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130833280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061904.557564:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789061904.557634:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130833280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061905.065768:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789061905.065790:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130833408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061905.065853:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061905.065926:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130833408 00000100:00100000:2.0:1789061905.065933:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130833408 00000100:00100000:2.0:1789061905.065980:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789061905.065990:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130833408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061905.066016:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061905.066057:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130833408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061905.066064:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1789061905.066082:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061905.066122:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd43fb80 x1875967130833408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061905.066315:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130833408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061905.067709:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061905.067724:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130833536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789061905.067780:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061905.067911:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130833536 00000100:00100000:2.0:1789061905.067917:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130833536 00000100:00100000:2.0:1789061905.067967:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789061905.067974:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130833536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789061905.067988:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061905.068021:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130833536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061905.068027:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789061905.068147:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789061905.068174:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7504380 x1875967130833536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061905.068188:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130833536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789061905.158781:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061905.160281:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061905.160317:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061905.160336:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061905.160359:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061905.160385:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120264192 00000100:00100000:0.0:1789061905.160394:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120264192 00000100:00100000:0.0:1789061905.160448:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120264448 00000100:00100000:0.0:1789061905.160451:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120264448 00000100:00100000:0.0:1789061905.160480:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120264064 00000100:00100000:0.0:1789061905.160483:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120264064 00000100:00100000:0.0:1789061905.160495:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120264320 00000100:00100000:0.0:1789061905.160498:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120264320 00000100:00100000:0.0:1789061905.160512:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 179 00000100:00100000:0.0:1789061905.160521:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120264192:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061905.160589:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120264192:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 68us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061905.160625:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 179 00000100:00100000:0.0:1789061905.160645:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:0.0:1789061905.160651:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120264448:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061905.160679:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120264448:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061905.160684:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:0.0:1789061905.160694:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:0.0:1789061905.160698:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2390:x1875967120264064:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061905.160719:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2390:x1875967120264064:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061905.160724:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:0.0:1789061905.160734:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:0.0:1789061905.160740:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120264320:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061905.160763:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120264320:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061905.160768:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00080000:0.0:1789061905.160787:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061905.160791:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789061905.162376:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120263936 00000100:00100000:2.0:1789061905.162385:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120263936 00000100:00100000:2.0:1789061905.162424:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 329 00000100:00100000:2.0:1789061905.162431:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2390:x1875967120263936:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061905.162477:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2390:x1875967120263936:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 47us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061905.162493:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 329 00010000:00010000:0.0:1789061905.195230:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789061905.314062:0:13361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789061906.218440:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061906.602878:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130833920:0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.602944:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061906.602992:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130834432:0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.603017:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061906.603054:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130834944:0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.603077:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061906.603111:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789061906.603118:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130834048:0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.603151:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061906.603173:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130834560:0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.603197:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061906.603213:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130835072:0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.603232:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061906.603260:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130833920 00000100:00100000:0.0:1789061906.603267:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130833920 00000100:00100000:0.0:1789061906.603305:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789061906.603312:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130833920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.603358:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130833920:12345-0@lo:400:kworker.0 Request processed in 46us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061906.603364:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789061906.603385:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130834432 00000100:00100000:0.0:1789061906.603389:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130834432 00000100:00100000:0.0:1789061906.603419:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130834944 00000100:00100000:0.0:1789061906.603422:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130834944 00000100:00100000:0.0:1789061906.603440:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130834048 00000100:00100000:0.0:1789061906.603443:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130834048 00000100:00100000:0.0:1789061906.603456:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789061906.603462:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130834432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.603495:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130834432:12345-0@lo:400:kworker.0 Request processed in 33us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061906.603501:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789061906.603521:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789061906.603527:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130834944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.603556:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130834944:12345-0@lo:400:kworker.0 Request processed in 29us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061906.603562:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789061906.603573:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789061906.603579:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130834048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.603639:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130834048:12345-0@lo:400:kworker.0 Request processed in 59us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061906.603645:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789061906.603669:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130834560 00000100:00100000:0.0:1789061906.603672:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130834560 00000100:00100000:0.0:1789061906.603697:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130835072 00000100:00100000:0.0:1789061906.603699:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130835072 00000100:00100000:0.0:1789061906.603719:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789061906.603726:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130834560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.603755:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130834560:12345-0@lo:400:kworker.0 Request processed in 29us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061906.603761:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789061906.603771:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789061906.603777:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130835072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.603801:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130835072:12345-0@lo:400:kworker.0 Request processed in 25us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061906.603805:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1789061906.603825:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061906.603829:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789061906.603865:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130834048:0@lo:400:kworker.0 00010000:00080000:0.0:1789061906.603886:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7751880 x1875967130834560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061906.603896:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130834560:0@lo:400:kworker.0 00010000:00080000:0.0:1789061906.603906:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d4e00 x1875967130835072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061906.603913:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130835072:0@lo:400:kworker.0 00000100:00100000:0.0:1789061906.603922:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130833920:0@lo:400:kworker.0 00010000:00080000:0.0:1789061906.603930:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7753b80 x1875967130834432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061906.603937:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130834432:0@lo:400:kworker.0 00010000:00080000:0.0:1789061906.603946:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d5c00 x1875967130834944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061906.603953:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130834944:0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604214:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130833792:0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604248:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061906.604265:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130834304:0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604284:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061906.604301:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130834816:0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604320:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061906.604347:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789061906.604353:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130833664:0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604380:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061906.604404:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130834176:0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604424:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061906.604441:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130834688:0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604460:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061906.604477:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130835200:0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604492:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061906.604526:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130833664 00000100:00100000:3.0:1789061906.604529:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130833664 00000100:00100000:3.0:1789061906.604556:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789061906.604563:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130833664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604596:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130833664:12345-0@lo:400:kworker.0 Request processed in 34us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061906.604602:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789061906.604641:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130834176 00000100:00100000:3.0:1789061906.604645:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130834176 00000100:00100000:3.0:1789061906.604667:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789061906.604673:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130834176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604698:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130834176:12345-0@lo:400:kworker.0 Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061906.604704:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789061906.604720:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130833792 00000100:00100000:3.0:1789061906.604723:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130833792 00000100:00100000:3.0:1789061906.604741:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130834304 00000100:00100000:3.0:1789061906.604743:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130834304 00000100:00100000:3.0:1789061906.604773:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130834816 00000100:00100000:3.0:1789061906.604776:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130834816 00000100:00100000:3.0:1789061906.604788:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789061906.604793:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130833792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604823:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130833792:12345-0@lo:400:kworker.0 Request processed in 30us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061906.604828:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789061906.604839:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789061906.604844:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130834304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604868:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130834304:12345-0@lo:400:kworker.0 Request processed in 25us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061906.604873:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789061906.604883:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789061906.604887:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130834816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.604908:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130834816:12345-0@lo:400:kworker.0 Request processed in 20us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061906.604913:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789061906.604932:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130834688 00000100:00100000:3.0:1789061906.604936:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130834688 00000100:00100000:3.0:1789061906.604953:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130835200 00000100:00100000:3.0:1789061906.604955:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130835200 00000100:00100000:3.0:1789061906.604971:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789061906.604976:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130834688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.605003:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130834688:12345-0@lo:400:kworker.0 Request processed in 27us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061906.605008:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789061906.605018:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789061906.605030:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130835200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.605056:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130835200:12345-0@lo:400:kworker.0 Request processed in 28us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061906.605061:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1789061906.605099:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061906.605103:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061906.605126:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130833664:0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.605136:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130834176:0@lo:400:kworker.0 00010000:00080000:3.0:1789061906.605146:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d4a80 x1875967130834688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061906.605155:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130834688:0@lo:400:kworker.0 00010000:00080000:3.0:1789061906.605163:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d5500 x1875967130835200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061906.605171:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130835200:0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.605179:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130833792:0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.605188:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130834304:0@lo:400:kworker.0 00000100:00100000:3.0:1789061906.605195:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130834816:0@lo:400:kworker.0 00000100:00100000:3.0:1789061907.118768:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130835328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061907.118839:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061907.120863:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130835328 00000100:00100000:0.0:1789061907.120876:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130835328 00000100:00100000:0.0:1789061907.120935:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789061907.120945:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130835328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789061907.120992:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789061907.121637:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130835328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 692us (2796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061907.121645:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789061907.121689:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130835328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061907.123822:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061907.123840:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130835456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061907.123895:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061907.123947:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130835456 00000100:00100000:1.0:1789061907.123953:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130835456 00000100:00100000:1.0:1789061907.123996:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789061907.124004:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130835456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789061907.124027:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061907.124069:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130835456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061907.124076:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1789061907.124125:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd344000 x1875967130835456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061907.124141:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130835456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061907.124739:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061907.124757:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130835584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061907.124802:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061907.124932:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130835584 00000100:00100000:2.0:1789061907.124937:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130835584 00000100:00100000:2.0:1789061907.124966:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789061907.124973:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130835584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061907.124985:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061907.125024:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd516d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130835584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061907.125030:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1789061907.125058:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f4573b80 x1875967130835584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061907.125071:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130835584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789061907.244493:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061908.265799:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061909.289753:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061909.673827:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061909.673851:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130835712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789061909.673915:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061909.674091:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130835712 00000100:00100000:3.0:1789061909.674119:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130835712 00000100:00100000:3.0:1789061909.674171:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789061909.674181:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130835712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789061909.674210:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789061909.674371:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130835712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061909.674378:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789061909.674714:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130835712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061910.186345:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061910.186379:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130835968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061910.186444:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061910.187415:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130835968 00000100:00100000:2.0:1789061910.187424:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130835968 00000100:00100000:2.0:1789061910.187503:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789061910.187514:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130835968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789061910.187544:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061910.187627:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130835968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061910.187635:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1789061910.187705:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061910.187788:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd344700 x1875967130835968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061910.187807:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130835968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061910.189688:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130835840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061910.189808:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061910.189947:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130835840 00000100:00100000:1.0:1789061910.191022:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130835840 00000100:00100000:1.0:1789061910.191107:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789061910.191117:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130835840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789061910.191141:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061910.191209:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130835840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061910.191216:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789061910.191468:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789061910.191548:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7507b80 x1875967130835840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061910.191571:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130835840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789061910.283910:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061910.283955:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061910.283997:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061910.284022:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061910.284049:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061910.284094:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120264576 00000100:00100000:0.0:1789061910.284104:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120264576 00000100:00100000:0.0:1789061910.284172:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 331 00000100:00100000:0.0:1789061910.284184:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2390:x1875967120264576:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061910.284272:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2390:x1875967120264576:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 90us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061910.284280:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 331 00000100:00100000:0.0:1789061910.284321:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120264704 00000100:00100000:0.0:1789061910.284325:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120264704 00000100:00100000:0.0:1789061910.284362:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120264960 00000100:00100000:0.0:1789061910.284364:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120264960 00000100:00100000:0.0:1789061910.284377:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120264832 00000100:00100000:0.0:1789061910.284380:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120264832 00000100:00100000:0.0:1789061910.284393:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120265088 00000100:00100000:0.0:1789061910.284395:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120265088 00000100:00100000:0.0:1789061910.284426:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:0.0:1789061910.284432:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2390:x1875967120264704:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061910.284466:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2390:x1875967120264704:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061910.284471:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:0.0:1789061910.284483:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:0.0:1789061910.284488:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120264960:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061910.284508:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120264960:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061910.284514:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:0.0:1789061910.284523:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:0.0:1789061910.284528:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120264832:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061910.284552:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120264832:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061910.284557:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:0.0:1789061910.284566:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:0.0:1789061910.284571:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120265088:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061910.284589:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120265088:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 18us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061910.284594:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00080000:0.0:1789061910.284769:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789061910.284774:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789061910.317278:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789061910.384690:0:13509:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 13:38:27 (1789061907) === 00000100:00100000:0.0:1789061910.730046:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061910.730138:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061910.730338:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120265344 00000100:00100000:2.0:1789061910.730352:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120265344 00000100:00100000:2.0:1789061910.730419:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:2.0:1789061910.730437:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:10486:x1875967120265344:12345-192.168.203.3@tcp:700:mkdir.0 00000100:00100000:2.0:1789061910.730766:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:10486:x1875967120265344:12345-192.168.203.3@tcp:700:mkdir.0 Request processed in 329us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061910.730774:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:3.0:1789061910.730978:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120265216 00000100:00100000:3.0:1789061910.730983:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120265216 00000100:00100000:3.0:1789061910.731027:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:3.0:1789061910.731035:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120265216:12345-192.168.203.3@tcp:41:mkdir.0 00000004:00000024:3.0:1789061910.731072:0:10077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789061910.731136:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120265216:12345-192.168.203.3@tcp:41:mkdir.0 Request processed in 102us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061910.731143:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:3.0:1789061910.735026:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061910.735238:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120265600 00000100:00100000:0.0:1789061910.735251:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120265600 00000100:00100000:0.0:1789061910.735321:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:0.0:1789061910.735332:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:10486:x1875967120265600:12345-192.168.203.3@tcp:36:mkdir.0 00010000:00010000:0.0:1789061910.735401:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061910.738704:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c74dbc00/0x2774d8f311dc676d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b746 expref: 6 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.738734:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d12d4900) 00010000:00010000:0.0:1789061910.738746:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061910.738838:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc68cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.738850:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc68cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.738860:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc68cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.738895:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc68d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.738901:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc68d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.738907:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc68d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739417:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc68d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739437:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc68d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739445:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc68d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061910.739462:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000feee0dde reply state 000000008b192d8c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc68d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739470:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc68d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739476:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3851a00) 00010000:00010000:0.0:1789061910.739478:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789061910.739482:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789061910.739487:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789061910.739493:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc68cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739498:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc68cb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739504:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc68cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739510:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061910.739514:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc68cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739521:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc68cb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739539:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767f3851200) 00010000:00010000:0.0:1789061910.739541:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061910.739546:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc68cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739552:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc68cb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061910.739566:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000feee0dde reply state 000000008b192d8c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc68d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739574:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc68d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.739580:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9767f3851f00) 00010000:00010000:0.0:1789061910.739582:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789061910.739584:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789061910.739715:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:10486:x1875967120265600:12345-192.168.203.3@tcp:36:mkdir.0 Request processed in 4383us (4702us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789061910.739723:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:1.0:1789061910.752218:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061910.753682:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120265728 00000100:00100000:3.0:1789061910.753700:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120265728 00000100:00100000:3.0:1789061910.753790:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:3.0:1789061910.753801:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:10487:x1875967120265728:12345-192.168.203.3@tcp:101:chmod.0 00010000:00010000:3.0:1789061910.753830:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061910.753879:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc68e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b7d9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061910.753966:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc68e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061910.753983:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc68e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061910.753998:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc68e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061910.754069:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789061910.754073:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789061910.754118:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc68e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061910.754153:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc68e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7d9 expref: 9 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061910.754175:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc68e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7d9 expref: 8 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061910.754184:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766c7417c00) 00010000:00010000:3.0:1789061910.754188:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789061910.754192:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3799a00, rc 0) 00000100:00100000:3.0:1789061910.756589:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:10487:x1875967120265728:12345-192.168.203.3@tcp:101:chmod.0 Request processed in 2776us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061910.756636:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1789061910.770778:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061910.773950:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120265984 00000100:00100000:2.0:1789061910.773970:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120265984 00000100:00100000:2.0:1789061910.774083:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1789061910.774100:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:10487:x1875967120265984:12345-192.168.203.3@tcp:36:chmod.0 00010000:00010000:2.0:1789061910.774180:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061910.774215:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc68e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7d9 expref: 8 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.774243:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766c7417c00) 00010000:00010000:2.0:1789061910.774255:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061910.774292:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc68ee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.774307:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc68ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.774319:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc68ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061910.775301:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da3d5ec3 reply state 00000000e15140ff transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc68ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.775323:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc68ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.775347:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fcfc0e00) 00010000:00010000:2.0:1789061910.775350:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789061910.775354:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789061910.775365:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789061910.775503:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:10487:x1875967120265984:12345-192.168.203.3@tcp:36:chmod.0 Request processed in 1405us (4736us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789061910.775513:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:0.0:1789061910.814032:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061910.817016:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120266112 00000100:00100000:2.0:1789061910.817037:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120266112 00000100:00100000:2.0:1789061910.817192:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:2.0:1789061910.817207:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:10488:x1875967120266112:12345-192.168.203.3@tcp:101:chown.0 00010000:00010000:2.0:1789061910.817240:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061910.817267:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc68f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b7e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.817357:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfc00/0x2774d8f311dc68fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.817375:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfc00/0x2774d8f311dc68fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.817390:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfc00/0x2774d8f311dc68fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061910.817448:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789061910.817453:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061910.817500:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfc00/0x2774d8f311dc68fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.817555:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc68f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7e0 expref: 11 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.817595:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfc00/0x2774d8f311dc68fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7e0 expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.817653:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fcfc0e00) 00010000:00010000:2.0:1789061910.817657:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061910.817662:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cfc00, rc 0) 00000100:00100000:2.0:1789061910.817772:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:10488:x1875967120266112:12345-192.168.203.3@tcp:101:chown.0 Request processed in 567us (3753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061910.817780:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:3.0:1789061910.822455:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061910.829878:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120266240 00000100:00100000:0.0:1789061910.830018:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120266240 00000100:00100000:0.0:1789061910.830117:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:0.0:1789061910.830131:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:10488:x1875967120266240:12345-192.168.203.3@tcp:101:chown.0 00010000:00010000:0.0:1789061910.830159:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061910.830188:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc6903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b7e7 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.830300:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc690a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.830318:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc690a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.830330:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc690a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.830344:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6911 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.830353:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.830359:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.830449:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6918 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.830458:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6918 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.830465:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6918 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061910.830516:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789061910.830521:0:10077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789061910.830545:0:10077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6918 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834080:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc690a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834105:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc690a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834115:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc690a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834122:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061910.834128:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc690a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834138:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc690a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834160:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fcfc0e00) 00010000:00010000:0.0:1789061910.834164:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061910.834170:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc690a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834177:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc690a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834201:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834208:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6911 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834214:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834241:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061910.834244:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834250:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6911 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834260:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9767f3851f00) 00010000:00010000:0.0:1789061910.834262:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061910.834266:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6911 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834271:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6911 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834333:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc6903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7e7 expref: 12 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834351:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6918 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7e7 expref: 11 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.834359:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3851a00) 00010000:00010000:0.0:1789061910.834361:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061910.834364:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031400, rc 0) 00000100:00100000:0.0:1789061910.834457:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:10488:x1875967120266240:12345-192.168.203.3@tcp:101:chown.0 Request processed in 4328us (12013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061910.834469:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:3.0:1789061910.851925:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061910.852196:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120266368 00000100:00100000:0.0:1789061910.852228:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120266368 00000100:00100000:0.0:1789061910.852306:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:0.0:1789061910.852319:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:10488:x1875967120266368:12345-192.168.203.3@tcp:900:chown.0 00000100:00100000:0.0:1789061910.852427:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:10488:x1875967120266368:12345-192.168.203.3@tcp:900:chown.0 Request processed in 111us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061910.852443:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1789061910.857236:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061910.857879:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120266624 00000100:00100000:0.0:1789061910.857892:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120266624 00000100:00100000:0.0:1789061910.857973:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:0.0:1789061910.857985:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:10488:x1875967120266624:12345-192.168.203.3@tcp:36:chown.0 00010000:00010000:0.0:1789061910.858069:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061910.858104:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6918 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7e7 expref: 11 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.858130:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3851a00) 00010000:00010000:0.0:1789061910.858137:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061910.858166:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc691f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.858183:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc691f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.858195:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc691f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061910.872647:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1789061910.872832:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a98dfd81 reply state 0000000068e69066 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc691f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.872860:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc691f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.872871:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3851a00) 00010000:00010000:2.0:1789061910.872875:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789061910.872881:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789061910.872897:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1789061910.873023:0:6498:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789061910.873050:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:10488:x1875967120266624:12345-192.168.203.3@tcp:36:chown.0 Request processed in 15061us (15823us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789061910.873070:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00010000:00010000:1.0:1789061910.873229:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc68d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873239:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc68d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873247:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc68d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873254:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061910.873260:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc68d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873293:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc68d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873307:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9767f3851f00) 00010000:00010000:1.0:1789061910.873310:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061910.873315:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc68d2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873322:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc68d2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873356:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc68d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873364:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc68d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873369:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc68d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873374:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061910.873377:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc68d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873383:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc68d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873391:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3851a00) 00010000:00010000:1.0:1789061910.873394:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061910.873397:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc68d9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873413:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc68d9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873429:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc68ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873435:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc68ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873440:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc68ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873445:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061910.873448:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc68ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873454:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc68ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873463:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fcfc0e00) 00010000:00010000:1.0:1789061910.873465:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789061910.873468:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc68ee lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.873473:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc68ee lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.874330:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc691f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.874358:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc691f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.874365:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc691f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.874370:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061910.874374:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc691f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.874381:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc691f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.874393:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3851a00) 00010000:00010000:0.0:1789061910.874395:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789061910.874398:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc691f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.874404:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc691f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061910.899062:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061910.899187:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120266752 00000100:00100000:2.0:1789061910.899220:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120266752 00000100:00100000:2.0:1789061910.899298:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:2.0:1789061910.899310:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:10489:x1875967120266752:12345-192.168.203.3@tcp:101:touch.500 00010000:00010000:2.0:1789061910.899341:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061910.899368:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc6926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b7ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789061910.901586:0:6497:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2137us 00010000:00010000:0.0:1789061910.929243:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc692d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929275:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc692d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929294:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc692d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929327:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6934 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929336:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6934 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929344:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6934 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929526:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc693b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929536:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc693b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929545:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc693b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061910.929584:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789061910.929589:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789061910.929661:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc693b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929677:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc692d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929684:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc692d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929692:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc692d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929711:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061910.929717:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc692d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929726:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc692d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929741:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fcfc0e00) 00010000:00010000:0.0:1789061910.929745:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061910.929751:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc692d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929759:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc692d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929772:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6934 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929779:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6934 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929785:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6934 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929791:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061910.929794:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6934 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929800:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6934 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929820:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9767f3852d00) 00010000:00010000:0.0:1789061910.929824:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061910.929827:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6934 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929834:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6934 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929887:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc6926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7ee expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929906:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc693b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7ee expref: 7 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.929914:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3852e00) 00010000:00010000:0.0:1789061910.929917:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789061910.929920:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030c00, rc 0) 00000100:00100000:0.0:1789061910.930019:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:10489:x1875967120266752:12345-192.168.203.3@tcp:101:touch.500 Request processed in 30709us (30981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061910.930030:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:3.0:1789061910.944889:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061910.945064:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120267008 00000100:00100000:1.0:1789061910.945077:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120267008 00000100:00100000:1.0:1789061910.945150:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:1.0:1789061910.945171:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:10489:x1875967120267008:12345-192.168.203.3@tcp:101:touch.500 00010000:00010000:1.0:1789061910.945217:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061910.945244:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc6942 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b7f5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.945388:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6949 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.945406:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6949 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.945421:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6949 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.953419:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6950 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.953440:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6950 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.953452:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6950 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789061910.953857:0:6496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789061910.954005:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6957 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954015:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954022:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954077:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6949 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954085:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6949 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954092:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6949 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954098:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061910.954101:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6949 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954109:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6949 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954120:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3852e00) 00010000:00010000:1.0:1789061910.954122:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061910.954127:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6949 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954133:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6949 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789061910.954143:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000369fdcd3 reply state 00000000eafc161a transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6950 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954153:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6950 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954159:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdc94a951 (ffff9766c15bfa00) 00010000:00010000:1.0:1789061910.954167:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789061910.954170:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789061910.954204:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc6942 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7f5 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954218:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6957 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7f5 expref: 9 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061910.954226:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9766c15bf200) 00010000:00010000:1.0:1789061910.954227:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061910.954230:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47ac00, rc 0) 00000100:00100000:1.0:1789061910.954304:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:10489:x1875967120267008:12345-192.168.203.3@tcp:101:touch.500 Request processed in 9136us (9431us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789061910.954313:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:0.0:1789061910.964717:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061910.965348:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120267264 00000100:00100000:2.0:1789061910.965367:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120267264 00000100:00100000:2.0:1789061910.965465:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:2.0:1789061910.965479:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:10489:x1875967120267264:12345-192.168.203.3@tcp:36:touch.500 00010000:00010000:2.0:1789061910.965559:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061910.965593:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6957 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7f5 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.965664:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9766c15bf200) 00010000:00010000:2.0:1789061910.965680:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061910.965761:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6965 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.965779:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6965 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.965791:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6965 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061910.965936:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001dbc42bd reply state 00000000721d821c transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6965 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.965970:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6965 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061910.965976:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9767fcfc0900) 00010000:00010000:2.0:1789061910.965979:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789061910.965982:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061910.966109:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:10489:x1875967120267264:12345-192.168.203.3@tcp:36:touch.500 Request processed in 634us (1400us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789061910.966116:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:2.0:1789061910.971303:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061910.971842:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120267392 00000100:00100000:0.0:1789061910.971857:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120267392 00000100:00100000:0.0:1789061910.971931:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:0.0:1789061910.971943:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:10489:x1875967120267392:12345-192.168.203.3@tcp:101:touch.500 00010000:00010000:0.0:1789061910.971967:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061910.971988:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc696c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b7fc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.972068:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc696c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7fc expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.972084:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc696c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7fc expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061910.972103:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9767fcfc0900) 00010000:00010000:0.0:1789061910.972106:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789061910.972110:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031400, rc 0) 00000100:00100000:0.0:1789061910.972177:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+12:10489:x1875967120267392:12345-192.168.203.3@tcp:101:touch.500 Request processed in 236us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061910.972184:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:0.0:1789061910.976225:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061910.976310:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120267520 00000100:00100000:3.0:1789061910.976319:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120267520 00000100:00100000:3.0:1789061910.976365:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:3.0:1789061910.976373:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1875967120267520:12345-192.168.203.3@tcp:8:touch.500 00010000:00080000:3.0:1789061910.976407:0:8613:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:3.0:1789061910.976436:0:8613:0:(genops.c:1384:class_connect()) connect: client 8b387fcf-29cb-4ebc-866a-7eab61aa3868, cookie 0x2774d8f311dc6973 00002000:00100000:3.0:1789061910.976447:0:8613:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8b387fcf-29cb-4ebc-866a-7eab61aa3868/ffff9767fd824800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789061910.976464:0:8613:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:3.0:1789061910.976536:0:8613:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789061910.976566:0:8613:0:(import.c:65:import_set_state_nolock()) ffff9767fd823000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789061910.976674:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2389:x1875967120267520:12345-192.168.203.3@tcp:8:touch.500 Request processed in 300us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061910.976681:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1789061910.984030:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061910.984134:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120267648 00000100:00100000:3.0:1789061910.984148:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120267648 00000100:00100000:3.0:1789061910.984231:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1789061910.984241:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:0:x1875967120267648:12345-192.168.203.3@tcp:2:touch.500 00000100:00080000:0.0:1789061910.984497:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789061910.989683:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1789061910.989703:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000100:00100000:3.0:1789061910.990247:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:0:x1875967120267648:12345-192.168.203.3@tcp:2:touch.500 Request processed in 5998us (6222us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789061910.990261:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1789061910.994707:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061910.994894:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120267904 00000100:00100000:3.0:1789061910.994906:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120267904 00000100:00100000:3.0:1789061910.995114:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:3.0:1789061910.995144:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+12:10489:x1875967120267904:12345-192.168.203.3@tcp:35:touch.500 00000100:00100000:2.0:1789061910.997953:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:10489:x1875967120267904:12345-192.168.203.3@tcp:35:touch.500 Request processed in 2783us (3229us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789061910.997974:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:0.0:1789061911.025596:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061911.028155:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120268032 00000100:00100000:1.0:1789061911.028174:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120268032 00000100:00100000:1.0:1789061911.028282:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:1.0:1789061911.028295:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:10490:x1875967120268032:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:1.0:1789061911.028329:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061911.028356:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc697a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b803 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061911.029291:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6981 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061911.029316:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6981 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061911.029333:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6981 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061911.034017:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789061911.034030:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061911.034123:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6981 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061911.034180:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc697a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b803 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061911.034208:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6981 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b803 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061911.034220:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3852e00) 00010000:00010000:1.0:1789061911.034223:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789061911.034227:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b400, rc 0) 00000100:00100000:1.0:1789061911.034509:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:10490:x1875967120268032:12345-192.168.203.3@tcp:101:rm.0 Request processed in 6214us (8927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.034520:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:0.0:1789061911.040856:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061911.041005:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120268288 00000100:00100000:3.0:1789061911.041018:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120268288 00000100:00100000:3.0:1789061911.041103:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:3.0:1789061911.041116:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:10490:x1875967120268288:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:3.0:1789061911.041143:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061911.041168:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6988 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b80a expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061911.041320:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789061911.041520:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6988 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b80a expref: 16 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.041539:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fcfc0e00) 00010000:00010000:3.0:1789061911.041542:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061911.041548:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6988 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b80a expref: 16 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.041817:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3799000, rc 0) 00000100:00100000:2.0:1789061911.042207:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:10490:x1875967120268288:12345-192.168.203.3@tcp:101:rm.0 Request processed in 1091us (1365us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789061911.042217:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:2.0:1789061911.052526:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061911.052653:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120268416 00000100:00100000:1.0:1789061911.052665:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120268416 00000100:00100000:1.0:1789061911.052742:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:1.0:1789061911.052755:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:10490:x1875967120268416:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:3.0:1789061911.057126:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:10490:x1875967120268416:12345-192.168.203.3@tcp:37:rm.0 Request processed in 4357us (4600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061911.057144:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1789061911.064031:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061911.064359:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120268672 00000100:00100000:2.0:1789061911.064372:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120268672 00000100:00100000:2.0:1789061911.064891:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:2.0:1789061911.064966:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f4a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:10490:x1875967120268672:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:2.0:1789061911.066658:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f4a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:10490:x1875967120268672:12345-192.168.203.3@tcp:35:rm.0 Request processed in 1746us (2631us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789061911.066689:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:2.0:1789061911.076358:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061911.076536:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120268928 00000100:00100000:3.0:1789061911.076778:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120268928 00000100:00100000:3.0:1789061911.076892:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:3.0:1789061911.076904:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:10490:x1875967120268928:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:3.0:1789061911.076935:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061911.077819:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b811 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.077964:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799c00/0x2774d8f311dc699d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.077982:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799c00/0x2774d8f311dc699d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.077996:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799c00/0x2774d8f311dc699d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061911.078008:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789061911.078179:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b811 expref: 19 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.078203:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799c00/0x2774d8f311dc699d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b811 expref: 18 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.078211:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3852e00) 00010000:00010000:3.0:1789061911.078215:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789061911.078219:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3799c00, rc 0) 00000100:00100000:3.0:1789061911.078292:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:10490:x1875967120268928:12345-192.168.203.3@tcp:101:rm.0 Request processed in 1390us (2020us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789061911.078300:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:0.0:1789061911.083133:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061911.083244:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120269056 00000100:00100000:1.0:1789061911.083257:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120269056 00000100:00100000:1.0:1789061911.083436:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:1.0:1789061911.083449:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:10490:x1875967120269056:12345-192.168.203.3@tcp:41:rm.0 00000004:00000024:1.0:1789061911.083522:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1789061911.083674:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:10490:x1875967120269056:12345-192.168.203.3@tcp:41:rm.0 Request processed in 228us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.083682:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:0.0:1789061911.087784:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061911.087895:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120269184 00000100:00100000:2.0:1789061911.087970:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120269184 00000100:00100000:2.0:1789061911.088048:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:2.0:1789061911.088069:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:10490:x1875967120269184:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:2.0:1789061911.088097:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061911.088123:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc69ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b818 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.088208:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc69b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.088227:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc69b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.088240:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc69b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.088250:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc69b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.088257:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc69b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.088264:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc69b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.088500:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc69c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.088528:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc69c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.088890:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc69c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061911.088997:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789061911.089003:0:10077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061911.089024:0:10077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc69c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089039:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc69c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089049:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc69b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089067:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc69b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089075:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc69b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089083:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061911.089088:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc69b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089097:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc69b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089111:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3852e00) 00010000:00010000:2.0:1789061911.089122:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061911.089128:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc69b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089135:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc69b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089154:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc69b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089160:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc69b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089167:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc69b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089173:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061911.089176:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc69b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089182:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc69b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089190:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdc94a951 (ffff9766c15bfa00) 00010000:00010000:2.0:1789061911.089193:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061911.089196:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc69b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089201:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc69b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089232:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc69ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b818 expref: 20 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089261:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc69c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b818 expref: 19 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.089270:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9767fcfc0900) 00010000:00010000:2.0:1789061911.089272:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061911.089275:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cfa00, rc 0) 00000100:00100000:2.0:1789061911.089476:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:10490:x1875967120269184:12345-192.168.203.3@tcp:101:rm.0 Request processed in 1407us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061911.089485:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:2.0:1789061911.093168:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061911.093263:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120269440 00000100:00100000:3.0:1789061911.093277:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120269440 00000100:00100000:3.0:1789061911.093426:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:3.0:1789061911.093438:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:10490:x1875967120269440:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:3.0:1789061911.093528:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789061911.093562:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc69c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b818 expref: 19 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.093589:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc696c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7fc expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.093602:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9767fcfc0900) 00010000:00010000:3.0:1789061911.093775:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b400/0x2774d8f311dc6981 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b803 expref: 17 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.093786:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3852e00) 00010000:00010000:3.0:1789061911.093789:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061911.096872:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf400/0x2774d8f311dc69c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.096974:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf400/0x2774d8f311dc69c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.096994:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf400/0x2774d8f311dc69c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.097019:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc69ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.097026:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc69ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.097033:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc69ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.097176:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfe00/0x2774d8f311dc69d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.097200:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfe00/0x2774d8f311dc69d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.097208:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfe00/0x2774d8f311dc69d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789061911.098209:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789061911.098221:0:8435:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 292207613861ns, next at 293207611181ns, rc = 0 00010000:00010000:2.0:1789061911.098282:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc69dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.098774:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc69dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.098784:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc69dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.098794:0:8435:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc69dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.098801:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc69dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.098807:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc69dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.098881:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061911.098921:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfe00/0x2774d8f311dc69d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.098928:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfe00/0x2774d8f311dc69d5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.098948:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfe00/0x2774d8f311dc69d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.098954:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cfe00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061911.098959:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfe00/0x2774d8f311dc69d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.098968:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfe00/0x2774d8f311dc69d5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.098982:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9767fcfc0900) 00010000:00010000:2.0:1789061911.098985:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789061911.098992:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfe00/0x2774d8f311dc69d5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.098998:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfe00/0x2774d8f311dc69d5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.099023:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf400/0x2774d8f311dc69c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.099030:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf400/0x2774d8f311dc69c7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.099036:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf400/0x2774d8f311dc69c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.099042:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061911.099045:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf400/0x2774d8f311dc69c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.099075:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf400/0x2774d8f311dc69c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.099084:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3852e00) 00010000:00010000:2.0:1789061911.099087:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061911.099091:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf400/0x2774d8f311dc69c7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.099097:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf400/0x2774d8f311dc69c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061911.099109:0:8435:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f0d3877 reply state 00000000b36d921f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc69ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.099121:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc69ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061911.099128:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdc94a951 (ffff9766c15bfa00) 00010000:00010000:2.0:1789061911.099131:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789061911.099134:0:8435:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061911.099259:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:10490:x1875967120269440:12345-192.168.203.3@tcp:36:rm.0 Request processed in 5817us (6099us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789061911.099269:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00010000:00010000:0.0:1789061911.104068:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061911.104087:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc69dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.104101:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cec00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789061911.104106:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc69dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.104146:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc69dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.104169:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9767fcfc0900) 00010000:00010000:0.0:1789061911.104172:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789061911.104178:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc69dc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.104184:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc69dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.104205:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061911.104207:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061911.104209:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061911.108402:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061911.108540:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120269696 00000100:00100000:3.0:1789061911.108552:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120269696 00000100:00100000:3.0:1789061911.108657:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1789061911.108670:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:10490:x1875967120269696:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1789061911.108964:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:10490:x1875967120269696:12345-192.168.203.3@tcp:35:rm.0 Request processed in 295us (575us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789061911.108971:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:1.0:1789061911.112367:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061911.112475:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120269952 00000100:00100000:3.0:1789061911.112487:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120269952 00000100:00100000:3.0:1789061911.112558:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:3.0:1789061911.112570:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:10490:x1875967120269952:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:3.0:1789061911.112682:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789061911.112716:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799c00/0x2774d8f311dc699d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b811 expref: 19 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.112764:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc693b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7ee expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.112778:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3852e00) 00010000:00010000:3.0:1789061911.112802:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfc00/0x2774d8f311dc68fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7e0 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.112813:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fcfc0e00) 00010000:00010000:3.0:1789061911.112821:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061911.112854:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc69e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.113092:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc69e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061911.113107:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc69e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113216:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc69ea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113227:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc69ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113237:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc69ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113344:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc69f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113353:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc69f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113360:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc69f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061911.113688:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789061911.113712:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc69f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113720:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc69f1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113727:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc69f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113734:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061911.113739:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc69f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113748:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc69f1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113757:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9767f3852b00) 00010000:00010000:0.0:1789061911.113761:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789061911.113765:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc69f1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113773:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030400/0x2774d8f311dc69f1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113794:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc69e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113800:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc69e3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113806:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc69e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113818:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061911.113822:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc69e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113828:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc69e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113837:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766c7417000) 00010000:00010000:0.0:1789061911.113840:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061911.113843:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc69e3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113849:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc69e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061911.113862:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e5c838e reply state 00000000273563bf transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc69ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113874:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc69ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061911.113880:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9767f3852d00) 00010000:00010000:0.0:1789061911.113882:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789061911.113885:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061911.114000:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:10490:x1875967120269952:12345-192.168.203.3@tcp:36:rm.0 Request processed in 1429us (1645us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789061911.114010:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00010000:00010000:1.0:1789061911.342022:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061911.722227:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130836096:0@lo:400:kworker.0 00000100:00100000:2.0:1789061911.722338:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.722543:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130836480:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.722582:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.722668:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130836992:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.722696:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.722716:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130837504:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.722737:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.722775:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789061911.722782:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130836608:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.722818:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.722839:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130837120:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.722862:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.722883:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130837632:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.722901:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.722930:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130836224:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.722964:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.722984:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130836736:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723006:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.723023:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130837248:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723044:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.723088:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789061911.723095:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130836352:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723117:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.723135:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130836864:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723156:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.723173:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130837376:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723191:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061911.723220:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130836992 00000100:00100000:1.0:1789061911.723229:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130836992 00000100:00100000:1.0:1789061911.723276:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130837504 00000100:00100000:1.0:1789061911.723279:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130837504 00000100:00100000:1.0:1789061911.723305:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130837120 00000100:00100000:1.0:1789061911.723307:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130837120 00000100:00100000:1.0:1789061911.723319:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130837632 00000100:00100000:1.0:1789061911.723321:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130837632 00000100:00100000:1.0:1789061911.723337:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789061911.723347:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130836992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723407:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130836992:12345-0@lo:400:kworker.0 Request processed in 60us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.723414:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789061911.723434:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789061911.723441:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130837504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723469:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130837504:12345-0@lo:400:kworker.0 Request processed in 30us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.723475:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789061911.723487:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789061911.723492:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130837120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723533:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130837120:12345-0@lo:400:kworker.0 Request processed in 40us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.723539:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789061911.723551:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789061911.723557:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130837632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723581:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130837632:12345-0@lo:400:kworker.0 Request processed in 25us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.723586:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789061911.723632:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130836608 00000100:00100000:1.0:1789061911.723636:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130836608 00000100:00100000:1.0:1789061911.723662:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130836352 00000100:00100000:1.0:1789061911.723664:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130836352 00000100:00100000:1.0:1789061911.723676:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789061911.723681:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130836608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723714:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130836608:12345-0@lo:400:kworker.0 Request processed in 33us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.723720:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789061911.723732:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789061911.723738:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130836352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723767:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130836352:12345-0@lo:400:kworker.0 Request processed in 29us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.723772:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789061911.723793:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130836480 00000100:00100000:1.0:1789061911.723796:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130836480 00000100:00100000:1.0:1789061911.723816:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130836224 00000100:00100000:1.0:1789061911.723819:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130836224 00000100:00100000:1.0:1789061911.723829:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130836736 00000100:00100000:1.0:1789061911.723839:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130836736 00000100:00100000:1.0:1789061911.723857:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130837248 00000100:00100000:1.0:1789061911.723859:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130837248 00000100:00100000:1.0:1789061911.723870:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130836864 00000100:00100000:1.0:1789061911.723872:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130836864 00000100:00100000:1.0:1789061911.723885:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130837376 00000100:00100000:1.0:1789061911.723887:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130837376 00000100:00100000:1.0:1789061911.723901:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789061911.723906:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130836480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723939:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130836480:12345-0@lo:400:kworker.0 Request processed in 33us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.723945:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789061911.723957:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789061911.723962:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130836224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.723988:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130836224:12345-0@lo:400:kworker.0 Request processed in 26us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.723993:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789061911.724003:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789061911.724009:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130836736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.724034:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130836736:12345-0@lo:400:kworker.0 Request processed in 26us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.724039:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789061911.724062:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789061911.724068:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130837248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.724096:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130837248:12345-0@lo:400:kworker.0 Request processed in 28us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.724102:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789061911.724136:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789061911.724142:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130836864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.724172:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130836864:12345-0@lo:400:kworker.0 Request processed in 30us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.724178:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789061911.724190:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789061911.724196:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130837376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.724221:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130837376:12345-0@lo:400:kworker.0 Request processed in 26us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061911.724227:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1789061911.724258:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789061911.724263:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061911.724265:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789061911.724301:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130836352:0@lo:400:kworker.0 00010000:00080000:1.0:1789061911.724317:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7513b80 x1875967130836864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061911.724330:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130836864:0@lo:400:kworker.0 00010000:00080000:1.0:1789061911.724341:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7513800 x1875967130837376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061911.724350:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130837376:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.724362:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130836224:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.724372:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130836736:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.724381:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130837248:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.724458:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130836608:0@lo:400:kworker.0 00010000:00080000:1.0:1789061911.724471:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7510a80 x1875967130837120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061911.724480:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130837120:0@lo:400:kworker.0 00010000:00080000:1.0:1789061911.724490:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7512d80 x1875967130837632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061911.724498:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130837632:0@lo:400:kworker.0 00000100:00100000:1.0:1789061911.724508:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130836480:0@lo:400:kworker.0 00010000:00080000:1.0:1789061911.724519:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7511880 x1875967130836992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061911.724527:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130836992:0@lo:400:kworker.0 00010000:00080000:1.0:1789061911.724538:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7512680 x1875967130837504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061911.724547:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130837504:0@lo:400:kworker.0 00000100:00100000:3.0:1789061911.729598:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130836096 00000100:00100000:3.0:1789061911.729641:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130836096 00000100:00100000:3.0:1789061911.730322:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789061911.730340:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130836096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061911.730546:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130836096:12345-0@lo:400:kworker.0 Request processed in 212us (8207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061911.730642:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789061911.730908:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130836096:0@lo:400:kworker.0 00000100:00100000:0.0:1789061912.235694:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130837760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061912.235808:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061912.235922:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130837760 00000100:00100000:0.0:1789061912.235932:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130837760 00000100:00100000:0.0:1789061912.235994:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789061912.236006:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130837760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789061912.236065:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789061912.236139:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130837760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061912.236147:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789061912.236319:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130837760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789061912.236556:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130838016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061912.236646:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061912.236719:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130837888:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1789061912.236762:0:9804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 293346154557ns, next at 294346150423ns, rc = 0 00000100:00100000:0.0:1789061912.236768:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061912.236819:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130838016 00000100:00100000:0.0:1789061912.236825:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130838016 00000100:00100000:0.0:1789061912.236866:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130837888 00000100:00100000:0.0:1789061912.236870:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130837888 00000100:00100000:0.0:1789061912.236885:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789061912.236893:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130838016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061912.236909:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061912.236973:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789061912.236984:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130837888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789061912.236997:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061912.237037:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130837888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061912.237053:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789061912.248307:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130838016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11399us (11646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061912.248326:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:0.0:1789061912.248508:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd43e300 x1875967130837888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061912.248539:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130837888:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789061912.249557:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676ed80 x1875967130838016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061912.249736:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130838016:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789061912.372131:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061913.387496:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061914.411803:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061914.796426:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061914.797164:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130838144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789061914.797251:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061914.797590:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130838144 00000100:00100000:3.0:1789061914.797601:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130838144 00000100:00100000:3.0:1789061914.797698:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789061914.797709:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130838144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789061914.797757:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789061914.797827:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130838144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061914.797834:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789061914.798095:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130838144:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1789061915.232359:0:13657:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1789061915.305883:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061915.305906:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130838400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061915.305973:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061915.306051:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130838272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789061915.306065:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130838400 00000100:00100000:0.0:1789061915.306078:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130838400 00000100:00100000:1.0:1789061915.306082:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789061915.306121:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061915.306133:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130838272 00000100:00100000:0.0:1789061915.306136:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130838272 00000100:00100000:0.0:1789061915.306165:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789061915.306173:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130838400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061915.306200:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061915.306240:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130838400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061915.306246:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1789061915.306258:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061915.306266:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789061915.306273:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130838272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789061915.306283:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1789061915.306292:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c75d6300 x1875967130838400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061915.306306:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130838272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061915.306313:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130838400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061915.306314:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1789061915.306334:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7511880 x1875967130838272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061915.306357:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130838272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789061915.418993:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061915.419045:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061915.419069:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061915.419085:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061915.419103:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061915.419124:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061915.419150:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120270336 00000100:00100000:0.0:1789061915.419158:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120270336 00000100:00100000:0.0:1789061915.419213:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120270592 00000100:00100000:0.0:1789061915.419216:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120270592 00000100:00100000:0.0:1789061915.419229:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120270208 00000100:00100000:0.0:1789061915.419231:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120270208 00000100:00100000:0.0:1789061915.419240:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120270720 00000100:00100000:0.0:1789061915.419243:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120270720 00000100:00100000:0.0:1789061915.419269:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 199 00000100:00100000:0.0:1789061915.419278:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120270336:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061915.419347:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120270336:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 70us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061915.419355:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 199 00000100:00100000:0.0:1789061915.419373:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 200 00000100:00100000:0.0:1789061915.419380:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120270592:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061915.419405:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120270592:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061915.419411:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 200 00000100:00100000:0.0:1789061915.419423:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00100000:0.0:1789061915.419429:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:2391:x1875967120270208:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061915.419455:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:2391:x1875967120270208:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061915.419461:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00100000:0.0:1789061915.419473:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:0.0:1789061915.419479:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120270720:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061915.419500:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120270720:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061915.419506:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:0.0:1789061915.419529:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120270464 00000100:00100000:0.0:1789061915.419533:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120270464 00000100:00100000:0.0:1789061915.419559:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:0.0:1789061915.419565:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120270464:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061915.419598:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120270464:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 33us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061915.419628:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00080000:0.0:1789061915.419647:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061915.419651:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061915.419653:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789061915.419823:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120270080 00000100:00100000:3.0:1789061915.419828:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120270080 00000100:00100000:3.0:1789061915.419867:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 333 00000100:00100000:3.0:1789061915.419874:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120270080:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061915.419910:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120270080:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 36us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061915.419916:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 333 00010000:00010000:2.0:1789061915.438553:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789061916.129511:0:13705:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1eaff8c0 20000000:00000080:3.0:1789061916.129528:0:13705:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9766c64f4400 uarg=0000000000000000 20000000:01000000:3.0:1789061916.129570:0:13705:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789061916.129577:0:13705:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789061916.129582:0:13705:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789061916.130568:0:13706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789061916.130868:0:13705:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789061916.137866:0:13705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789061916.137918:0:13705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789061916.137935:0:13705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789061916.137951:0:13705:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789061916.137970:0:13705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.137989:0:13705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c3799400/0x2774d8f311dc6885 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7cb expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.137997:0:13705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc688c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7d2 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.138004:0:13705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c3799200/0x2774d8f311dc689a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6893 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.138010:0:13705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c1483200/0x2774d8f311dc68a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc68a1 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.138026:0:13705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c1483600/0x2774d8f311dc68b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc68af expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.138032:0:13705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c3798200/0x2774d8f311dc68c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc68bd expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.138051:0:13705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.138087:0:13705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c3798200/0x2774d8f311dc68c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc68bd expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.138100:0:13705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c3798200/0x2774d8f311dc68c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc68bd expref: 23 pid: 6490 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061916.138114:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7751c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875967130838528:0@lo:104: 00000100:00100000:0.0:1789061916.138193:0:13705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061916.138484:0:13705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c1483600/0x2774d8f311dc68b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc68af expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.138493:0:13705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c1483600/0x2774d8f311dc68b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc68af expref: 23 pid: 6488 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061916.138502:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7753480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875967130838656:0@lo:104: 00010000:00010000:0.0:1789061916.138528:0:13705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c1483200/0x2774d8f311dc68a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc68a1 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.138535:0:13705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c1483200/0x2774d8f311dc68a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc68a1 expref: 23 pid: 6488 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061916.138542:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7750000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875967130838784:0@lo:104: 00010000:00010000:0.0:1789061916.138562:0:13705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c3799200/0x2774d8f311dc689a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc6893 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.138569:0:13705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9767c3799200/0x2774d8f311dc689a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc6893 expref: 23 pid: 6491 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061916.138584:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7753b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875967130838912:0@lo:104: 00010000:00010000:0.0:1789061916.138635:0:13705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc688c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7d2 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.138645:0:13705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc688c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7d2 expref: 12 pid: 6488 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061916.138654:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7751880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875967130839040:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061916.139535:0:13705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c3799400/0x2774d8f311dc6885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7cb expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.139546:0:13705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9767c3799400/0x2774d8f311dc6885 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7cb expref: 12 pid: 6488 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061916.139556:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7753800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875967130839168:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061916.139652:0:13705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd594b40 going to sleep for 11 seconds 00000004:00080000:1.0:1789061916.141806:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789061916.141857:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1789061916.141867:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1789061916.141896:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6950 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.141907:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6950 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.141915:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6950 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.141920:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47be00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061916.141924:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6950 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.141932:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6950 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.141965:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdc94a951 (ffff9766c15bfa00) 00010000:00010000:1.0:1789061916.141968:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061916.141974:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6950 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.141980:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6950 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.141998:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6965 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142004:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6965 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142009:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6965 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142024:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cea00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061916.142027:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6965 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142033:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6965 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142041:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9767fcfc0900) 00010000:00010000:1.0:1789061916.142043:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061916.142045:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6965 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142050:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6965 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142081:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc69ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142088:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc69ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142094:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc69ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142100:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061916.142103:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc69ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142109:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc69ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142117:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdc94a951 (ffff9766c15bfa00) 00010000:00010000:1.0:1789061916.142119:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061916.142121:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc69ce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142125:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc69ce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142139:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc69ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142145:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc69ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142149:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc69ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142174:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061916.142178:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc69ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142184:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc69ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142201:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9767f3852d00) 00010000:00010000:1.0:1789061916.142367:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061916.142374:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc69ea lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.142381:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc69ea lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061916.143010:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130839296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789061916.143087:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061916.143199:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130839296 00000100:00100000:2.0:1789061916.143213:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130839296 00000100:00100000:2.0:1789061916.143276:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789061916.143287:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130839296:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1789061916.143532:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1789061916.143586:0:8613:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1789061916.143655:0:8613:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa2eb15, atime: 0x6aa2eb15, ctime: 0x6aa2eb15, blocks: 0x0 00010000:00010000:2.0:1789061916.143662:0:8613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc69ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.143677:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=297s v=(0 0) 00010000:00010000:2.0:1789061916.143681:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061916.143686:0:8613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc69ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.143700:0:8613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc69ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.143708:0:8613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc69ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.143715:0:8613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc69ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.143744:0:8613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789061916.143890:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875967130839296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 606us (803us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789061916.143897:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1789061916.143945:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9767fd43c380/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789061916.143952:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130839296:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789061916.144012:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061916.144027:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc69ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.144036:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789061916.144040:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc69ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.144059:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc69ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.144076:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc69ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.144083:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc69ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.144103:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061916.144105:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061916.144106:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061916.144755:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789061916.144781:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061916.144839:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061916.144905:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061916.144958:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130838528 00000100:00100000:1.0:1789061916.144966:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130838528 00000100:00100000:1.0:1789061916.144995:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130838656 00000100:00100000:1.0:1789061916.144998:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130838656 00000100:00100000:1.0:1789061916.145008:0:7437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130838784 00000100:00100000:1.0:1789061916.145010:0:7437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130838784 00000100:00100000:1.0:1789061916.145034:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789061916.145042:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7426850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:13705:x1875967130838528:12345-0@lo:104: 00010000:00010000:1.0:1789061916.145056:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc68c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145118:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789061916.145124:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7426850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+5:13705:x1875967130838528:12345-0@lo:104: Request processed in 83us (6940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061916.145141:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789061916.145197:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789061916.145204:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:13705:x1875967130838656:12345-0@lo:104: 00010000:00010000:1.0:1789061916.145220:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc68b6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145254:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789061916.145258:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+4:13705:x1875967130838656:12345-0@lo:104: Request processed in 56us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061916.145263:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789061916.145275:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789061916.145280:0:7437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:13705:x1875967130838784:12345-0@lo:104: 00010000:00010000:1.0:1789061916.145286:0:7437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc68a8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145330:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789061916.145334:0:7437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:13705:x1875967130838784:12345-0@lo:104: Request processed in 54us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061916.145338:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1789061916.145353:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789061916.145358:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc68c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145365:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1482200 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789061916.145369:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc68c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145388:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc68c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061916.145405:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc68c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061916.145410:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789061916.145438:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc68c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145445:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061916.145461:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc68c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145467:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1482200/0x2774d8f311dc68bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc68c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145479:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789061916.145482:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc68b6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145487:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1482c00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789061916.145490:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc68b6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145497:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc68b6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061916.145503:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc68b6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061916.145515:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789061916.145530:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc68b6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145535:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061916.145552:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc68b6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145558:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1482c00/0x2774d8f311dc68af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc68b6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145566:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061916.145569:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc68a8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145574:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483000 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789061916.145577:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc68a8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145583:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc68a8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061916.145588:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc68a8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061916.145593:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789061916.145603:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc68a8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145627:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061916.145640:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc68a8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145647:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc68a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc68a8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145655:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061916.145657:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061916.145658:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061916.145671:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130839424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061916.145708:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061916.145748:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130839552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061916.145771:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061916.145787:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061916.145793:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130839680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061916.145810:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061916.145836:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130839424 00000100:00100000:1.0:1789061916.145840:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130839424 00010000:00010000:1.0:1789061916.145860:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c3798200/0x2774d8f311dc68c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc68bd expref: 24 pid: 6490 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061916.145879:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130839552 00000100:00100000:1.0:1789061916.145881:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130839552 00010000:00010000:1.0:1789061916.145891:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c1483600/0x2774d8f311dc68b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc68af expref: 25 pid: 6488 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061916.145899:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130839680 00000100:00100000:1.0:1789061916.145901:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130839680 00010000:00010000:1.0:1789061916.145909:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c1483200/0x2774d8f311dc68a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc68a1 expref: 26 pid: 6488 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061916.145930:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789061916.145936:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+26:3621:x1875967130839424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061916.145945:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061916.145950:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c3798200/0x2774d8f311dc68c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc68bd expref: 26 pid: 6490 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145960:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c3798200/0x2774d8f311dc68c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc68bd expref: 26 pid: 6490 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.145975:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061916.146004:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+26:3621:x1875967130839424:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061916.146009:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789061916.146035:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789061916.146041:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+25:3622:x1875967130839552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061916.146049:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061916.146053:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c1483600/0x2774d8f311dc68b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc68af expref: 25 pid: 6488 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.146061:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c1483600/0x2774d8f311dc68b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc68af expref: 25 pid: 6488 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.146069:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061916.146093:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+25:3622:x1875967130839552:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061916.146099:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789061916.146111:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789061916.146122:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130839680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061916.146129:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061916.146134:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c1483200/0x2774d8f311dc68a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc68a1 expref: 24 pid: 6488 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.146141:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c1483200/0x2774d8f311dc68a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc68a1 expref: 24 pid: 6488 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.146150:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061916.146170:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130839680:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061916.146175:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789061916.146210:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130839424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061916.146232:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130839680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061916.146238:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130839552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061916.146257:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061916.146678:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061916.146721:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3798200/0x2774d8f311dc68c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc68bd expref: 23 pid: 6490 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061916.146733:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7751c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875967130838528:0@lo:104: 00010000:00010000:2.0:1789061916.146744:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1483600/0x2774d8f311dc68b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc68af expref: 22 pid: 6488 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061916.146751:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7753480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875967130838656:0@lo:104: 00010000:00010000:2.0:1789061916.146760:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1483200/0x2774d8f311dc68a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc68a1 expref: 21 pid: 6488 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061916.146768:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7750000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875967130838784:0@lo:104: 00000100:00100000:3.0:1789061916.147783:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130838912 00000100:00100000:3.0:1789061916.147791:0:6479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130838912 00000100:00100000:0.0:1789061916.147879:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789061916.147888:0:6478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:13705:x1875967130838912:12345-0@lo:104: 00010000:00010000:0.0:1789061916.147902:0:6478:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc689a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.147961:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789061916.147966:0:6478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+3:13705:x1875967130838912:12345-0@lo:104: Request processed in 81us (3061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061916.147971:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1789061916.148007:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061916.148012:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc689a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.148028:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3798a00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789061916.148031:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc689a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.148039:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc689a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061916.148045:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc689a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061916.148059:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789061916.148087:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc689a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.148093:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789061916.148110:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc689a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.148116:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c3798a00/0x2774d8f311dc6893 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc689a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.148129:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061916.148131:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061916.148132:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061916.148139:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061916.148149:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130839808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061916.148204:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061916.148248:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130839808 00000100:00100000:1.0:1789061916.148252:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130839808 00010000:00010000:1.0:1789061916.148271:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c3799200/0x2774d8f311dc689a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6893 expref: 21 pid: 6491 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061916.148480:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7753b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875967130838912:0@lo:104: 00000100:00100000:1.0:1789061916.148643:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789061916.148652:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3621:x1875967130839808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061916.148663:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061916.148669:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c3799200/0x2774d8f311dc689a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc6893 expref: 21 pid: 6491 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.148679:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c3799200/0x2774d8f311dc689a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc6893 expref: 21 pid: 6491 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.148699:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3799200/0x2774d8f311dc689a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc6893 expref: 21 pid: 6491 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.148711:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061916.148747:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:3621:x1875967130839808:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061916.148753:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789061916.148821:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130839808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061916.157037:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061916.157134:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120270848 00000100:00100000:1.0:1789061916.157144:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120270848 00010000:00010000:1.0:1789061916.157201:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc688c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7d2 expref: 13 pid: 6488 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061916.157255:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:1.0:1789061916.157268:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21c8093b-edf9-482d-a900-a6298c53147f+13:2393:x1875967120270848:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061916.157286:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061916.157512:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc688c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7d2 expref: 13 pid: 6488 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.157525:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc688c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7d2 expref: 13 pid: 6488 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.157544:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061916.157584:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc688c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7d2 expref: 13 pid: 6488 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061916.157597:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7751880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875967130839040:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061916.158850:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21c8093b-edf9-482d-a900-a6298c53147f+12:2393:x1875967120270848:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1580us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061916.158862:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:1.0:1789061916.160174:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061916.160772:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7753800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875967130839168:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061916.160814:0:13705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061916.164987:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120270976 00000100:00100000:3.0:1789061916.165003:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120270976 00010000:00010000:2.0:1789061916.165748:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c3799400/0x2774d8f311dc6885 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7cb expref: 12 pid: 6488 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061916.165789:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:2.0:1789061916.165798:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21c8093b-edf9-482d-a900-a6298c53147f+12:2392:x1875967120270976:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061916.165813:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061916.165819:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c3799400/0x2774d8f311dc6885 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7cb expref: 12 pid: 6488 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.165832:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c3799400/0x2774d8f311dc6885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7cb expref: 12 pid: 6488 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.165848:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3799400/0x2774d8f311dc6885 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b7cb expref: 12 pid: 6488 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.165862:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.165870:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.165886:0:9499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.165894:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.165912:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.165920:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.165926:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789061916.165930:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.165938:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.166758:0:13705:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061916.166769:0:13705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.167222:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.167233:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031800/0x2774d8f311dc69f8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061916.167250:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061916.167364:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:21c8093b-edf9-482d-a900-a6298c53147f+11:2392:x1875967120270976:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1564us (7203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061916.167373:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00010000:00010000:1.0:1789061916.457766:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061916.842323:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130840320:0@lo:400:kworker.0 00000100:00100000:2.0:1789061916.842414:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130839936:0@lo:400:kworker.0 00000100:00100000:2.0:1789061916.843106:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061916.843162:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130840448:0@lo:400:kworker.0 00000100:00100000:2.0:1789061916.843185:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061916.843212:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130840960:0@lo:400:kworker.0 00000100:00100000:2.0:1789061916.843246:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061916.843292:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130839936 00000100:00100000:2.0:1789061916.843298:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130839936 00000100:00100000:2.0:1789061916.843341:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130840448 00000100:00100000:2.0:1789061916.843345:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130840448 00000100:00100000:2.0:1789061916.843370:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130840960 00000100:00100000:2.0:1789061916.843373:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130840960 00000100:00100000:2.0:1789061916.843393:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789061916.843403:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130839936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061916.843456:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130839936:12345-0@lo:400:kworker.0 Request processed in 54us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061916.843463:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789061916.843483:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789061916.843490:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130840448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061916.843521:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130840448:12345-0@lo:400:kworker.0 Request processed in 31us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061916.843527:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789061916.843539:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789061916.843546:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130840960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061916.843576:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130840960:12345-0@lo:400:kworker.0 Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061916.843582:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:2.0:1789061916.843603:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061916.843861:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061916.843889:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130840832:0@lo:400:kworker.0 00000100:00100000:1.0:1789061916.843932:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061916.843972:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130840064:0@lo:400:kworker.0 00000100:00100000:1.0:1789061916.843998:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061916.844033:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130840576:0@lo:400:kworker.0 00000100:00100000:1.0:1789061916.844063:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061916.844088:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130841088:0@lo:400:kworker.0 00000100:00100000:1.0:1789061916.844108:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061916.844124:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789061916.844130:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130840192:0@lo:400:kworker.0 00000100:00100000:1.0:1789061916.844151:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061916.844167:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130840704:0@lo:400:kworker.0 00000100:00100000:0.0:1789061916.844186:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130840832 00000100:00100000:1.0:1789061916.844191:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061916.844193:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130840832 00000100:00100000:1.0:1789061916.844212:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130841216:0@lo:400:kworker.0 00000100:00100000:0.0:1789061916.844228:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130840704 00000100:00100000:0.0:1789061916.844232:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130840704 00000100:00100000:1.0:1789061916.844237:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061916.844253:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130841216 00000100:00100000:0.0:1789061916.844257:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130841216 00000100:00100000:1.0:1789061916.844284:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130840320 00000100:00100000:0.0:1789061916.844284:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789061916.844292:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130840832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061916.844302:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130840320 00000100:00100000:1.0:1789061916.844331:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130840064 00000100:00100000:1.0:1789061916.844335:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130840064 00000100:00100000:0.0:1789061916.844344:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130840832:12345-0@lo:400:kworker.0 Request processed in 51us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061916.844352:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789061916.844360:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130840320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061916.844366:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789061916.844386:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789061916.844396:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130840704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061916.844404:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130840320:12345-0@lo:400:kworker.0 Request processed in 44us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061916.844412:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789061916.844438:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130840704:12345-0@lo:400:kworker.0 Request processed in 44us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061916.844440:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789061916.844451:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789061916.844453:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130840064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061916.844470:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789061916.844479:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130841216:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789061916.844491:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789061916.844493:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130840064:12345-0@lo:400:kworker.0 Request processed in 43us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061916.844501:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789061916.844507:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130840576 00000100:00100000:2.0:1789061916.844513:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130840576 00000100:00100000:0.0:1789061916.844518:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130841216:12345-0@lo:400:kworker.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061916.844526:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789061916.844549:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130841088 00000100:00100000:2.0:1789061916.844553:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130841088 00000100:00100000:2.0:1789061916.844579:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130840192 00000100:00100000:2.0:1789061916.844582:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130840192 00000100:00100000:2.0:1789061916.844596:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789061916.844603:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130840576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061916.844655:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130840576:12345-0@lo:400:kworker.0 Request processed in 52us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061916.844662:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789061916.844674:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789061916.844680:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130841088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061916.844705:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130841088:12345-0@lo:400:kworker.0 Request processed in 25us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061916.844712:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789061916.844722:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789061916.844729:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130840192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061916.844752:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130840192:12345-0@lo:400:kworker.0 Request processed in 24us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061916.844757:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789061916.844804:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130839936:0@lo:400:kworker.0 00000100:00100000:2.0:1789061916.844814:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130840448:0@lo:400:kworker.0 00000100:00100000:2.0:1789061916.844823:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130840960:0@lo:400:kworker.0 00000100:00080000:2.0:1789061916.844845:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061916.845055:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130840320:0@lo:400:kworker.0 00010000:00080000:1.0:1789061916.845068:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd5f8700 x1875967130840832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061916.845079:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130840832:0@lo:400:kworker.0 00000100:00100000:1.0:1789061916.845109:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130840192:0@lo:400:kworker.0 00010000:00080000:1.0:1789061916.845118:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd5f9180 x1875967130840704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061916.845126:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130840704:0@lo:400:kworker.0 00000100:00100000:1.0:1789061916.845136:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130841216:0@lo:400:kworker.0 00000100:00100000:1.0:1789061916.845144:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130840064:0@lo:400:kworker.0 00010000:00080000:1.0:1789061916.845152:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd5fad80 x1875967130840576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061916.845160:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130840576:0@lo:400:kworker.0 00010000:00080000:1.0:1789061916.845170:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd5f8380 x1875967130841088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061916.845179:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130841088:0@lo:400:kworker.0 00000020:00000080:1.0:1789061916.862837:0:13754:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1102ca00 20000000:00000080:1.0:1789061916.862859:0:13754:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9767fd3c2800 uarg=0000000000000000 20000000:01000000:1.0:1789061916.862899:0:13754:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789061916.862905:0:13754:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789061916.862910:0:13754:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1789061916.866752:0:13755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789061916.866943:0:13754:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1789061916.867077:0:13754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1789061916.867110:0:13754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1789061916.867126:0:13754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1789061916.867140:0:13754:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789061916.867163:0:13754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a06 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.867178:0:13754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a06 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.867190:0:13754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a06 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.867198:0:13754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a06 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.867205:0:13754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a06 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.867212:0:13754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a06 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.867218:0:13754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b400 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789061916.867224:0:13754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a06 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.867237:0:13754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a06 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.867267:0:13754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a06 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.867275:0:13754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a06 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061916.867283:0:13754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a06 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061917.355457:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061917.355478:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130841600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061917.355539:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061917.355623:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130841600 00000100:00100000:1.0:1789061917.355630:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130841600 00000100:00100000:1.0:1789061917.355669:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789061917.355678:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130841600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789061917.355706:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061917.355748:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130841600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.355754:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789061917.355803:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130841600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789061917.356385:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130841344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061917.356424:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061917.357798:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061917.357811:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130841472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789061917.357874:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061917.359313:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130841472 00000100:00100000:1.0:1789061917.359324:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130841472 00000100:00100000:1.0:1789061917.359785:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789061917.359796:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130841472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789061917.359828:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789061917.359899:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130841472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (2025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.359916:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789061917.360018:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130841472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061917.360517:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130841344 00000100:00100000:3.0:1789061917.360522:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130841344 00000100:00100000:3.0:1789061917.360564:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789061917.360572:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875967130841344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061917.360588:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061917.361690:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875967130841344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1115us (5261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061917.361701:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789061917.364093:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130841344:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789061917.481876:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789061917.482053:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789061917.482057:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fd65c800 from 7 10000000:01000000:0.0:1789061917.482078:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789061917.482120:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061917.482132:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061917.482143:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061917.482167:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130841728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789061917.482249:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061917.482303:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130841728 00000100:00100000:3.0:1789061917.482311:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130841728 00000100:00100000:0.0:1789061917.482316:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd594300 going to sleep for 11 seconds 00000100:00100000:3.0:1789061917.482366:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789061917.482375:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:6493:x1875967130841728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061917.482387:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061917.482399:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6a14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6a0d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061917.482419:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6a0d expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061917.482588:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6a0d expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061917.482597:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3799c00, rc 0) 00000100:00100000:3.0:1789061917.482664:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130841728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 290us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061917.482670:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789061917.482749:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130841728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061917.482763:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061917.482772:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061917.482828:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130841856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061917.482852:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061917.482880:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd594300 going to sleep for 11 seconds 00000100:00100000:2.0:1789061917.483650:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130841856 00000100:00100000:2.0:1789061917.483657:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130841856 00000100:00100000:2.0:1789061917.483700:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789061917.483708:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130841856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061917.483835:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130841856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061917.483842:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789061917.483873:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130841856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061917.483906:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130841984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061917.483967:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061917.483993:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd594300 going to sleep for 11 seconds 00000100:00100000:3.0:1789061917.484542:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130841984 00000100:00100000:3.0:1789061917.484549:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130841984 00000100:00100000:3.0:1789061917.484593:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789061917.484600:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130841984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061917.484728:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130841984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061917.484734:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789061917.486517:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130841984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789061917.488579:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13767:1875967130842112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061917.488691:0:13767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061917.488735:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e540 going to sleep for 11 seconds 00000100:00100000:0.0:1789061917.490092:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130842112 00000100:00100000:0.0:1789061917.490114:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130842112 00000100:00100000:0.0:1789061917.490174:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789061917.490183:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:13767:x1875967130842112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061917.490344:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:13767:x1875967130842112:12345-0@lo:502:llog_process_th.0 Request processed in 162us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061917.490352:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789061917.490515:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13767:1875967130842112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061917.490561:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061917.490569:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061917.490572:0:13767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789061917.490578:0:13767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767fd65c800 00000020:00000080:2.0:1789061917.490581:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789061917.490665:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061917.490668:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061917.490669:0:13767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789061917.490672:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789061917.490674:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061917.490675:0:13767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789061917.490678:0:13767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767fd65c800 00000020:00000080:2.0:1789061917.490680:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789061917.490739:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13767:1875967130842240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061917.490777:0:13767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061917.490809:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e540 going to sleep for 11 seconds 00000100:00100000:0.0:1789061917.491077:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130842240 00000100:00100000:0.0:1789061917.491083:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130842240 00000100:00100000:0.0:1789061917.491121:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789061917.491129:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:13767:x1875967130842240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789061917.491211:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:13767:x1875967130842240:12345-0@lo:502:llog_process_th.0 Request processed in 83us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061917.491218:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789061917.491348:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13767:1875967130842240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789061917.491366:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789061917.491370:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789061917.491372:0:13767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789061917.491375:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789061917.491637:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789061917.491662:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789061917.491672:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061917.491683:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061917.491693:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789061917.491695:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fd12c000 from 7 10000000:01000000:0.0:1789061917.491698:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789061917.491723:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061917.491730:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061917.491750:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061917.491767:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd513800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130842368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789061917.491799:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061917.491821:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd594300 going to sleep for 11 seconds 00000100:00100000:3.0:1789061917.491882:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130842368 00000100:00100000:3.0:1789061917.491888:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130842368 00000100:00100000:3.0:1789061917.491926:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789061917.491936:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:6493:x1875967130842368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061917.491945:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061917.491958:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c3798600/0x2774d8f311dc6a22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6a1b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061917.491981:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c3798600/0x2774d8f311dc6a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6a1b expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061917.491992:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c3798600/0x2774d8f311dc6a22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6a1b expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061917.492024:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3798600, rc 0) 00000100:00100000:3.0:1789061917.492058:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130842368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061917.492065:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789061917.492149:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd513800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130842368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789061917.492163:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061917.492173:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061917.492228:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd513800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130842496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061917.492255:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061917.492279:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd594300 going to sleep for 11 seconds 00000100:00100000:3.0:1789061917.492327:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130842496 00000100:00100000:3.0:1789061917.492332:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130842496 00000100:00100000:3.0:1789061917.492363:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1789061917.492370:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130842496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061917.492592:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130842496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061917.492599:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789061917.492719:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd513800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130842496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789061917.492750:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd513800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130842624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789061917.492792:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061917.492822:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd594300 going to sleep for 11 seconds 00000100:00100000:3.0:1789061917.493158:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130842624 00000100:00100000:3.0:1789061917.493164:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130842624 00000100:00100000:3.0:1789061917.493198:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789061917.493206:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130842624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061917.493287:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130842624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061917.493295:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789061917.493338:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd513800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130842624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789061917.494636:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13769:1875967130842752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061917.494698:0:13769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061917.494731:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130842752 00000100:00100000:3.0:1789061917.494736:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130842752 00000100:00100000:3.0:1789061917.494763:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789061917.494776:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:13769:x1875967130842752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061917.494854:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:13769:x1875967130842752:12345-0@lo:502:llog_process_th.0 Request processed in 79us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061917.494861:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789061917.494892:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c75c96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061917.494906:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13769:1875967130842752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789061917.494926:0:13769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061917.494933:0:13769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061917.494936:0:13769:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789061917.494943:0:13769:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767fd12c000 00000020:00000080:3.0:1789061917.494945:0:13769:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789061917.494985:0:13769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061917.494988:0:13769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061917.494989:0:13769:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789061917.494991:0:13769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789061917.494994:0:13769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061917.494995:0:13769:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789061917.494998:0:13769:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767fd12c000 00000020:00000080:3.0:1789061917.495000:0:13769:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789061917.495037:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13769:1875967130842880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061917.495066:0:13769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061917.495084:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130842880 00000100:00100000:3.0:1789061917.495087:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130842880 00000100:00100000:3.0:1789061917.495106:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789061917.495112:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:13769:x1875967130842880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789061917.495168:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:13769:x1875967130842880:12345-0@lo:502:llog_process_th.0 Request processed in 55us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061917.495174:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789061917.495207:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c75c96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061917.495218:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13769:1875967130842880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789061917.495236:0:13769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789061917.495240:0:13769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789061917.495241:0:13769:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789061917.495245:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789061917.495303:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789061917.495321:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789061917.495329:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061917.495340:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061917.495351:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789061917.495353:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fb057800 from 7 10000000:01000000:3.0:1789061917.495356:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789061917.495381:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061917.495387:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061917.495395:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061917.499527:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130843008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789061917.499596:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061917.499658:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c75c96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061917.500262:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130843008 00000100:00100000:2.0:1789061917.500272:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130843008 00000100:00100000:2.0:1789061917.500328:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789061917.500339:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:6493:x1875967130843008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061917.500354:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061917.500372:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c80cfe00/0x2774d8f311dc6a30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6a29 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061917.500396:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c80cfe00/0x2774d8f311dc6a30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6a29 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061917.500419:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c80cfe00/0x2774d8f311dc6a30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6a29 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061917.500427:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cfe00, rc 0) 00000100:00100000:2.0:1789061917.500475:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130843008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061917.500481:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789061917.500669:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130843008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061917.500686:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061917.500695:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061917.500767:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130843136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.500798:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061917.500820:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061917.501104:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130843136 00000100:00100000:3.0:1789061917.501122:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130843136 00000100:00100000:3.0:1789061917.503088:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789061917.503104:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130843136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061917.503254:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130843136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061917.503262:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789061917.504446:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130843136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.504503:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130843264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.504560:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061917.504592:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061917.504624:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130843264 00000100:00100000:1.0:1789061917.504631:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130843264 00000100:00100000:1.0:1789061917.504665:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789061917.504671:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130843264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.504763:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130843264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.504770:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789061917.504826:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130843264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.505506:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13771:1875967130843392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061917.505758:0:13771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061917.505784:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130843392 00000100:00100000:1.0:1789061917.505789:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130843392 00000100:00100000:1.0:1789061917.505809:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789061917.505816:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:13771:x1875967130843392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061917.505889:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:13771:x1875967130843392:12345-0@lo:502:llog_process_th.0 Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.505896:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789061917.505933:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bb480 going to sleep for 11 seconds 00000100:00100000:1.0:1789061917.505947:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13771:1875967130843392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789061917.505968:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061917.505976:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061917.505979:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789061917.505986:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767fb057800 00000020:00000080:1.0:1789061917.505988:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789061917.507683:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061917.507692:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061917.507694:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789061917.507698:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061917.507702:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061917.507703:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789061917.507708:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767fb057800 00000020:00000080:1.0:1789061917.507711:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789061917.514819:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13771:1875967130843520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061917.514898:0:13771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061917.514943:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bb480 going to sleep for 11 seconds 00000100:00100000:2.0:1789061917.514999:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130843520 00000100:00100000:2.0:1789061917.515017:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130843520 00000100:00100000:2.0:1789061917.515070:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789061917.515085:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:13771:x1875967130843520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061917.515201:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:13771:x1875967130843520:12345-0@lo:502:llog_process_th.0 Request processed in 116us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061917.515209:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789061917.518220:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13771:1875967130843520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789061917.518281:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061917.518296:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061917.518299:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789061917.518304:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789061917.518592:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789061917.518672:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061917.518683:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061917.518694:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061917.518703:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789061917.518706:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767c3163000 from 7 10000000:01000000:2.0:1789061917.518709:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789061917.518738:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061917.518746:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061917.518755:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061917.518775:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130843648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789061917.518828:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061917.518863:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789061917.518943:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130843648 00000100:00100000:1.0:1789061917.518951:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130843648 00000100:00100000:1.0:1789061917.518992:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789061917.519000:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:6493:x1875967130843648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061917.519023:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061917.519036:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc6a37 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061917.519058:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc6a37 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061917.519068:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc6a37 expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061917.519077:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b400, rc 0) 00000100:00100000:1.0:1789061917.519115:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130843648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.519121:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789061917.519663:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130843648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789061917.519678:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061917.519688:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061917.519746:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6729c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130843776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789061917.519777:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061917.519794:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c75c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1789061917.520438:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130843776 00000100:00100000:1.0:1789061917.520445:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130843776 00000100:00100000:1.0:1789061917.520481:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789061917.520489:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130843776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.520618:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130843776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.520626:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789061917.520666:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6729c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130843776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.520714:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130843904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.520754:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061917.520771:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789061917.520785:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130843904 00000100:00100000:1.0:1789061917.520789:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130843904 00000100:00100000:1.0:1789061917.520811:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1789061917.520817:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130843904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.520890:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:6493:x1875967130843904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.520896:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1789061917.520945:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4c9b030-cc89-4fa3-a2aa-771221619f7d:6493:1875967130843904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.521128:0:13773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13773:1875967130844032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061917.521166:0:13773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061917.521184:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130844032 00000100:00100000:1.0:1789061917.521187:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130844032 00000100:00100000:1.0:1789061917.521207:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789061917.521213:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:13773:x1875967130844032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061917.521287:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:13773:x1875967130844032:12345-0@lo:502:llog_process_th.0 Request processed in 74us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.521294:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789061917.521333:0:13773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789061917.521343:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13773:1875967130844032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789061917.521362:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061917.521369:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061917.521376:0:13773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789061917.521382:0:13773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767c3163000 00000020:00000080:1.0:1789061917.521385:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789061917.521431:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061917.521695:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061917.521697:0:13773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789061917.521701:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789061917.521704:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061917.521706:0:13773:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789061917.521709:0:13773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767c3163000 00000020:00000080:1.0:1789061917.521711:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000040:00080000:0.0:1789061917.521711:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789061917.524087:0:13773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13773:1875967130844160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789061917.524776:0:13773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061917.524825:0:13773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061917.524930:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130844160 00000100:00100000:2.0:1789061917.524937:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130844160 00000100:00100000:2.0:1789061917.524999:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789061917.525018:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:13773:x1875967130844160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789061917.525123:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:13773:x1875967130844160:12345-0@lo:502:llog_process_th.0 Request processed in 116us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061917.525131:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789061917.525394:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4c9b030-cc89-4fa3-a2aa-771221619f7d:13773:1875967130844160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789061917.525497:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789061917.525505:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789061917.525507:0:13773:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789061917.525512:0:13773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789061917.525720:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789061917.525744:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789061917.525753:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061917.525764:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789061917.545670:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789061917.765419:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061917.765598:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120271104 00000100:00100000:1.0:1789061917.765645:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120271104 00000100:00100000:1.0:1789061917.765691:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 354 00000100:00100000:1.0:1789061917.765699:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+11:6165:x1875967120271104:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789061917.765714:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061917.765829:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6a45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b81f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061917.765859:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b81f expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061917.765887:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b81f expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061917.765896:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b200, rc 0) 00000100:00100000:1.0:1789061917.767139:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+12:6165:x1875967120271104:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 1435us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.767149:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 354 00000100:00100000:1.0:1789061917.778876:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061917.779068:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120271232 00000100:00100000:2.0:1789061917.779077:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120271232 00000100:00100000:2.0:1789061917.779129:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 355 00000100:00100000:2.0:1789061917.779138:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+12:6165:x1875967120271232:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789061917.779272:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+12:6165:x1875967120271232:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 134us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061917.779279:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 355 00000100:00100000:3.0:1789061917.781872:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061917.784775:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120271360 00000100:00100000:1.0:1789061917.784791:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120271360 00000100:00100000:1.0:1789061917.784863:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 356 00000100:00100000:1.0:1789061917.784873:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+12:6165:x1875967120271360:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.785030:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+12:6165:x1875967120271360:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 158us (3165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.785038:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 356 00000100:00100000:0.0:1789061917.796687:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061917.797243:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120271488 00000100:00100000:1.0:1789061917.797252:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120271488 00000100:00100000:1.0:1789061917.797315:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 357 00000100:00100000:1.0:1789061917.797325:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+12:10774:x1875967120271488:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789061917.797489:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+12:10774:x1875967120271488:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 165us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.797498:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 357 00000100:00100000:0.0:1789061917.808191:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061917.812519:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120271616 00000100:00100000:2.0:1789061917.812534:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120271616 00000100:00100000:2.0:1789061917.812644:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 358 00000100:00100000:2.0:1789061917.812655:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+12:10774:x1875967120271616:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789061917.812801:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+12:10774:x1875967120271616:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 148us (4617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061917.812819:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 358 00000100:00100000:3.0:1789061917.819958:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061917.820151:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120271744 00000100:00100000:2.0:1789061917.820161:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120271744 00000100:00100000:2.0:1789061917.820219:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 359 00000100:00100000:2.0:1789061917.820229:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+12:6165:x1875967120271744:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789061917.820248:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061917.820267:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c80cfc00/0x2774d8f311dc6a4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b826 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061917.820296:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c80cfc00/0x2774d8f311dc6a4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b826 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061917.820307:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c80cfc00/0x2774d8f311dc6a4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b826 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061917.820315:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cfc00, rc 0) 00000100:00100000:2.0:1789061917.820373:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:6165:x1875967120271744:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 146us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061917.820387:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 359 00000100:00100000:0.0:1789061917.826746:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061917.826856:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120271872 00000100:00100000:1.0:1789061917.826867:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120271872 00000100:00100000:1.0:1789061917.826926:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 360 00000100:00100000:1.0:1789061917.826944:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:6165:x1875967120271872:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.827106:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:6165:x1875967120271872:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 163us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.827114:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 360 00000100:00100000:0.0:1789061917.832175:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061917.832299:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120272000 00000100:00100000:1.0:1789061917.832308:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120272000 00000100:00100000:1.0:1789061917.832358:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 361 00000100:00100000:1.0:1789061917.832367:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:6165:x1875967120272000:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789061917.832495:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:6165:x1875967120272000:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 129us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061917.832503:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 361 00000100:00100000:3.0:1789061917.838486:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061917.838589:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120272128 00000100:00100000:2.0:1789061917.838600:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120272128 00000100:00100000:2.0:1789061917.838691:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 362 00000100:00100000:2.0:1789061917.838702:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:10777:x1875967120272128:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789061917.838839:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:10777:x1875967120272128:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 139us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061917.838848:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 362 00000100:00100000:0.0:1789061917.842973:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061917.843085:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120272256 00000100:00100000:2.0:1789061917.843095:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120272256 00000100:00100000:2.0:1789061917.843203:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 363 00000100:00100000:2.0:1789061917.843214:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:10777:x1875967120272256:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789061917.843378:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:10777:x1875967120272256:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 166us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061917.843873:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 363 00010000:00010000:1.0:1789061918.506124:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789061918.571378:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789061918.571867:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789061919.529775:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061919.913914:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130844288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061919.913986:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061919.914124:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130844288 00000100:00100000:1.0:1789061919.914132:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130844288 00000100:00100000:1.0:1789061919.914191:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789061919.914201:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130844288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789061919.914238:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789061919.914297:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130844288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061919.914304:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789061919.914392:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130844288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061920.426348:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061920.426371:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130844416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789061920.426439:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061920.426799:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061920.426809:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130844544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061920.426840:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061920.426917:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130844416 00000100:00100000:0.0:1789061920.426925:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130844416 00000100:00100000:0.0:1789061920.426974:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130844544 00000100:00100000:0.0:1789061920.426978:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130844544 00000100:00100000:0.0:1789061920.427004:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789061920.427013:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130844416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789061920.427040:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061920.427067:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789061920.427076:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130844544:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061920.427079:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130844416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061920.427085:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00002000:00000024:1.0:1789061920.427086:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061920.427114:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130844544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061920.427132:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1789061920.427159:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061920.427187:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd510e00 x1875967130844544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061920.427205:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130844544:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789061920.427254:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd51ea00 x1875967130844416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061920.427274:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130844416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061920.523631:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061920.523680:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061920.523712:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061920.523754:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061920.523779:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061920.523805:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061920.523839:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120272384 00000100:00100000:1.0:1789061920.523848:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120272384 00000100:00100000:1.0:1789061920.523896:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 364 00000100:00100000:1.0:1789061920.523906:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2390:x1875967120272384:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061920.523975:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2390:x1875967120272384:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 70us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061920.523998:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120272768 00000100:00100000:0.0:1789061920.524003:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120272768 00000100:00100000:1.0:1789061920.524005:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 364 00000100:00100000:0.0:1789061920.524048:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:0.0:1789061920.524056:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120272768:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061920.524197:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120272512 00000100:00100000:3.0:1789061920.524202:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120272512 00000100:00100000:3.0:1789061920.524232:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120273024 00000100:00100000:3.0:1789061920.524235:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120273024 00000100:00100000:3.0:1789061920.524249:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120272640 00000100:00100000:3.0:1789061920.524251:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120272640 00000100:00100000:3.0:1789061920.524264:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120272896 00000100:00100000:3.0:1789061920.524266:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120272896 00000100:00100000:3.0:1789061920.524281:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 209 00000100:00100000:3.0:1789061920.524289:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120272512:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061920.524528:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 210 00000100:00100000:2.0:1789061920.524540:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120273024:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061920.527791:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120272768:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 3724us (4100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061920.527807:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:0.0:1789061920.527876:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 211 00000100:00100000:0.0:1789061920.527889:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120272640:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061920.527932:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120272640:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 49us (4153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061920.527939:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 211 00000100:00100000:0.0:1789061920.527957:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 212 00000100:00100000:0.0:1789061920.527964:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120272896:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061920.528017:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120272896:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 54us (4211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061920.528024:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 212 00000100:00080000:0.0:1789061920.528045:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789061920.528050:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061920.528052:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061920.529181:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120272512:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 4887us (5578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061920.529192:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 209 00000100:00100000:2.0:1789061920.529473:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120273024:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 4935us (5759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061920.529482:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 210 00010000:00010000:2.0:1789061920.553916:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061921.578158:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061921.961911:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130844928:0@lo:400:kworker.0 00000100:00100000:3.0:1789061921.961913:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130845056:0@lo:400:kworker.0 00000100:00100000:0.0:1789061921.962188:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130844800:0@lo:400:kworker.0 00000100:00100000:1.0:1789061921.962243:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130844672:0@lo:400:kworker.0 00000100:00100000:3.0:1789061921.971179:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061921.971246:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130845568:0@lo:400:kworker.0 00000100:00100000:3.0:1789061921.974746:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061921.974823:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130846080:0@lo:400:kworker.0 00000100:00100000:3.0:1789061921.974864:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061921.975018:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130845568 00000100:00100000:3.0:1789061921.975027:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130845568 00000100:00100000:3.0:1789061921.975070:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130846080 00000100:00100000:3.0:1789061921.975073:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130846080 00000100:00100000:3.0:1789061921.975112:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789061921.975121:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130845568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061921.975189:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130845568:12345-0@lo:400:kworker.0 Request processed in 69us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061921.975196:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789061921.975212:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789061921.975219:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130846080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061921.975248:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130846080:12345-0@lo:400:kworker.0 Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061921.975253:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789061921.975294:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130846080:0@lo:400:kworker.0 00010000:00080000:3.0:1789061921.975307:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7753800 x1875967130845568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061921.975318:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130845568:0@lo:400:kworker.0 00000100:00080000:0.0:1789061921.975325:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061921.975351:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130845056 00000100:00100000:3.0:1789061921.975355:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130845056 00000100:00100000:0.0:1789061921.975370:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061921.975385:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130844800 00000100:00100000:3.0:1789061921.975388:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130844800 00000100:00100000:3.0:1789061921.975405:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789061921.975409:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789061921.975411:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130845056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061921.975415:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130844800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061921.975441:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130844800:12345-0@lo:400:kworker.0 Request processed in 27us (70us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061921.975443:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130845056:12345-0@lo:400:kworker.0 Request processed in 33us (4272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061921.975448:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789061921.975484:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130844800:0@lo:400:kworker.0 00000100:00100000:0.0:1789061921.975492:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130845312:0@lo:400:kworker.0 00000100:00100000:0.0:1789061921.975514:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061921.975533:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130845824:0@lo:400:kworker.0 00000100:00100000:0.0:1789061921.975566:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061921.975584:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130845312 00000100:00100000:0.0:1789061921.975587:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130845312 00000100:00100000:3.0:1789061921.976867:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789061921.976894:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130845824 00000100:00100000:3.0:1789061921.976900:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130845824 00000100:00100000:3.0:1789061921.977012:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789061921.977020:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130845824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061921.977095:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130845824:12345-0@lo:400:kworker.0 Request processed in 76us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061921.977101:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789061921.977296:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130845056:0@lo:400:kworker.0 00000100:00100000:1.0:1789061921.977817:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061921.977851:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130845184:0@lo:400:kworker.0 00000100:00100000:1.0:1789061921.977882:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061921.977905:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130845184 00000100:00100000:1.0:1789061921.977911:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130845184 00000100:00100000:1.0:1789061921.977944:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789061921.977951:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130845184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061921.977999:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130845184:12345-0@lo:400:kworker.0 Request processed in 47us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061921.978005:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789061921.978044:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130845184:0@lo:400:kworker.0 00000100:00100000:1.0:1789061921.978051:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130845696:0@lo:400:kworker.0 00000100:00100000:1.0:1789061921.978077:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061921.978099:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130845696 00000100:00100000:1.0:1789061921.978103:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130845696 00000100:00100000:1.0:1789061921.978126:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789061921.978133:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130845696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061921.978162:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130845696:12345-0@lo:400:kworker.0 Request processed in 30us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061921.978167:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1789061921.978194:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7751880 x1875967130845696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061921.978206:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130845696:0@lo:400:kworker.0 00000100:00100000:1.0:1789061921.978213:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130846208:0@lo:400:kworker.0 00000100:00100000:1.0:1789061921.978234:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061921.978253:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130846208 00000100:00100000:1.0:1789061921.978257:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130846208 00000100:00100000:1.0:1789061921.978283:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789061921.978289:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875967130846208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061921.978318:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875967130846208:12345-0@lo:400:kworker.0 Request processed in 29us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061921.978324:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789061921.978347:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130846208:0@lo:400:kworker.0 00000100:00080000:1.0:1789061921.978382:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061921.978387:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061921.978414:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130845824:0@lo:400:kworker.0 00000100:00100000:3.0:1789061921.978588:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130844672 00000100:00100000:3.0:1789061921.978592:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130844672 00000100:00100000:3.0:1789061921.978673:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789061921.978680:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130844672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061921.978720:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130844672:12345-0@lo:400:kworker.0 Request processed in 42us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061921.978725:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789061921.978823:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061921.978862:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130845440:0@lo:400:kworker.0 00000100:00100000:2.0:1789061921.978891:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061921.978908:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130845952:0@lo:400:kworker.0 00000100:00100000:2.0:1789061921.978927:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061921.978956:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130845440 00000100:00100000:2.0:1789061921.978960:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130845440 00000100:00100000:2.0:1789061921.978999:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130845952 00000100:00100000:2.0:1789061921.979002:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130845952 00000100:00100000:2.0:1789061921.979021:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789061921.979027:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130845440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061921.979061:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130845440:12345-0@lo:400:kworker.0 Request processed in 34us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061921.979067:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789061921.979079:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789061921.979085:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130845952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061921.979110:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130845952:12345-0@lo:400:kworker.0 Request processed in 25us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061921.979116:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:2.0:1789061921.979131:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789061921.979150:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd345500 x1875967130845440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061921.979160:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130845440:0@lo:400:kworker.0 00010000:00080000:2.0:1789061921.979168:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7750000 x1875967130845952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061921.979175:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130845952:0@lo:400:kworker.0 00000001:00080000:1.0:1789061921.979286:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1789061921.979310:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130844672:0@lo:400:kworker.0 00000100:00100000:0.0:1789061921.979391:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789061921.979401:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130845312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061921.979447:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130845312:12345-0@lo:400:kworker.0 Request processed in 48us (3931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061921.979467:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789061921.979538:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130845312:0@lo:400:kworker.0 00000100:00100000:3.0:1789061921.979594:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130844928 00000100:00100000:3.0:1789061921.979599:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130844928 00000100:00100000:3.0:1789061921.979648:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789061921.979655:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130844928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061921.979701:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130844928:12345-0@lo:400:kworker.0 Request processed in 46us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061921.979707:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789061921.980052:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130844928:0@lo:400:kworker.0 00000100:00100000:1.0:1789061922.473772:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061922.473793:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130846336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061922.473857:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061922.473875:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130846464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061922.473903:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061922.473924:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130846464 00000100:00100000:1.0:1789061922.473931:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130846464 00000100:00100000:0.0:1789061922.473937:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130846336 00000100:00100000:0.0:1789061922.473939:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130846336 00000100:00100000:1.0:1789061922.473981:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789061922.473981:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789061922.473989:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130846336:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061922.473997:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130846464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789061922.474025:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:0.0:1789061922.474025:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061922.474064:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130846464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061922.474064:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130846336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061922.474072:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789061922.474072:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789061922.474344:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130846592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061922.474385:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130846336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061922.474560:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130846464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061922.474933:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061922.475075:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130846592 00000100:00100000:1.0:1789061922.475080:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130846592 00000100:00100000:1.0:1789061922.475231:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789061922.475240:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130846592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061922.475254:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061922.475299:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130846592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061922.475306:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789061922.475371:0:3621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1789061922.475376:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9767fd43c380, transno 4294967301 00000100:00100000:3.0:1789061922.475399:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130846592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789061922.603382:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061923.627186:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061924.650010:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061925.038631:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061925.038655:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130846720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789061925.038725:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061925.039009:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130846720 00000100:00100000:1.0:1789061925.039018:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130846720 00000100:00100000:1.0:1789061925.039074:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789061925.039083:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130846720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789061925.039114:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789061925.039170:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130846720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061925.039177:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789061925.043093:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130846720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789061925.546096:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130846848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061925.546166:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061925.546241:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130846848 00000100:00100000:1.0:1789061925.546250:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130846848 00000100:00100000:1.0:1789061925.546303:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789061925.546312:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130846848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061925.546340:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061925.546382:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130846848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061925.546389:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1789061925.546408:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789061925.546433:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd512d80 x1875967130846848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061925.546451:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130846848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061925.546803:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061925.546814:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130846976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061925.546840:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061925.546881:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130846976 00000100:00100000:1.0:1789061925.546885:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130846976 00000100:00100000:1.0:1789061925.546911:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1789061925.546916:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061925.546917:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130846976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789061925.546928:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061925.546979:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130846976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061925.546984:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1789061925.547007:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fb25bb80 x1875967130846976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061925.547020:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130846976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789061925.637763:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061925.637887:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061925.637963:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061925.638001:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061925.638020:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061925.638060:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061925.638126:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120273280 00000100:00100000:3.0:1789061925.638143:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120273280 00000100:00100000:3.0:1789061925.638205:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120273792 00000100:00100000:3.0:1789061925.638208:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120273792 00000100:00100000:3.0:1789061925.638222:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120273408 00000100:00100000:3.0:1789061925.638224:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120273408 00000100:00100000:3.0:1789061925.638236:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120273664 00000100:00100000:3.0:1789061925.638238:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120273664 00000100:00100000:3.0:1789061925.638978:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 219 00000100:00100000:3.0:1789061925.638997:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120273280:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061925.639099:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120273280:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 109us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061925.639102:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120273536 00000100:00100000:3.0:1789061925.639111:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 219 00000100:00100000:0.0:1789061925.639117:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120273536 00000100:00100000:3.0:1789061925.639152:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 220 00000100:00100000:3.0:1789061925.639165:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120273792:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061925.639196:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120273792:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 35us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061925.639205:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 220 00000100:00100000:0.0:1789061925.639222:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00100000:3.0:1789061925.639228:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 221 00000100:00100000:0.0:1789061925.639239:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120273536:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061925.639242:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120273408:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061925.639277:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120273408:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 38us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061925.639285:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 221 00000100:00100000:3.0:1789061925.639311:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 222 00000100:00100000:3.0:1789061925.639321:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120273664:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061925.639355:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120273536:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 119us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061925.639365:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00080000:0.0:1789061925.639399:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061925.639404:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789061925.639409:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061925.640252:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120273664:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 930us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061925.640262:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 222 00000100:00100000:1.0:1789061925.642395:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120273152 00000100:00100000:1.0:1789061925.642413:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120273152 00000100:00100000:1.0:1789061925.642501:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 366 00000100:00100000:1.0:1789061925.642512:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120273152:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061925.642591:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120273152:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 81us (4843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061925.642599:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 366 00010000:00010000:1.0:1789061925.673947:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061926.697927:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061927.082289:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130847488:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.082387:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.082489:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130848000:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.082518:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.082540:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130848512:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.082561:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.082589:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789061927.082596:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130847104:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.082678:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.082701:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130847616:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.082752:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.082773:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130848128:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.082814:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.082833:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130848640:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.082857:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.082887:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c751aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130847360:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.082911:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.082927:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130847872:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.082962:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.082979:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130848384:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083001:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.083018:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789061927.083024:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c751b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130847232:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083046:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.083063:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f4505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130847744:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083083:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.083097:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130848256:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083123:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.083151:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130848000 00000100:00100000:1.0:1789061927.083161:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130848000 00000100:00100000:1.0:1789061927.083213:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130848512 00000100:00100000:1.0:1789061927.083217:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130848512 00000100:00100000:1.0:1789061927.083232:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130848128 00000100:00100000:1.0:1789061927.083234:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130848128 00000100:00100000:1.0:1789061927.083246:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130848640 00000100:00100000:1.0:1789061927.083248:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130848640 00000100:00100000:1.0:1789061927.083276:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789061927.083286:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130848000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083350:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130848000:12345-0@lo:400:kworker.0 Request processed in 64us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061927.083357:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789061927.083377:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789061927.083383:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130848512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083412:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130848512:12345-0@lo:400:kworker.0 Request processed in 30us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061927.083419:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789061927.083432:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789061927.083438:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130848128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083462:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130848128:12345-0@lo:400:kworker.0 Request processed in 25us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061927.083468:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789061927.083477:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789061927.083483:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130848640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083504:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130848640:12345-0@lo:400:kworker.0 Request processed in 22us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061927.083509:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789061927.083533:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130847616 00000100:00100000:1.0:1789061927.083537:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130847616 00000100:00100000:1.0:1789061927.083559:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130847360 00000100:00100000:1.0:1789061927.083561:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130847360 00000100:00100000:1.0:1789061927.083573:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789061927.083579:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130847616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083651:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130847616:12345-0@lo:400:kworker.0 Request processed in 71us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061927.083657:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789061927.083668:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789061927.083674:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130847360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083707:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130847360:12345-0@lo:400:kworker.0 Request processed in 34us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061927.083712:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789061927.083760:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c751aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130847360:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083795:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130847616:0@lo:400:kworker.0 00010000:00080000:1.0:1789061927.083810:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7717100 x1875967130848128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061927.083820:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130848128:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083830:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130848640:0@lo:400:kworker.0 00010000:00080000:1.0:1789061927.083840:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7715c00 x1875967130848000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061927.083847:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130848000:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.083855:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130848512:0@lo:400:kworker.0 00000100:00100000:2.0:1789061927.084120:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130847488 00000100:00100000:2.0:1789061927.084127:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130847488 00000100:00100000:2.0:1789061927.084159:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130847872 00000100:00100000:2.0:1789061927.084162:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130847872 00000100:00100000:2.0:1789061927.084179:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130848384 00000100:00100000:2.0:1789061927.084181:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130848384 00000100:00100000:2.0:1789061927.084193:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130847232 00000100:00100000:2.0:1789061927.084195:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130847232 00000100:00100000:2.0:1789061927.084204:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130847744 00000100:00100000:2.0:1789061927.084206:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130847744 00000100:00100000:2.0:1789061927.084218:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130848256 00000100:00100000:2.0:1789061927.084220:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130848256 00000100:00100000:2.0:1789061927.084236:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789061927.084243:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130847488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061927.084296:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130847488:12345-0@lo:400:kworker.0 Request processed in 55us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061927.084303:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789061927.084317:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789061927.084323:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130847872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061927.084358:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130847872:12345-0@lo:400:kworker.0 Request processed in 35us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061927.084363:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789061927.084375:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789061927.084380:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130848384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061927.084408:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130848384:12345-0@lo:400:kworker.0 Request processed in 28us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061927.084426:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789061927.084439:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789061927.084445:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130847232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061927.084493:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130847232:12345-0@lo:400:kworker.0 Request processed in 48us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061927.084499:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789061927.084511:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789061927.084516:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130847744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061927.084549:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130847744:12345-0@lo:400:kworker.0 Request processed in 28us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061927.084554:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789061927.084566:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789061927.084575:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130848256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061927.084601:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130848256:12345-0@lo:400:kworker.0 Request processed in 28us (1478us total) trans 0 rc 0/0 00000100:00080000:0.0:1789061927.084862:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061927.084868:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789061927.084871:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061927.084874:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061927.084902:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789061927.084968:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c751b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130847232:0@lo:400:kworker.0 00000100:00100000:2.0:1789061927.084982:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130847744:0@lo:400:kworker.0 00000100:00100000:2.0:1789061927.084992:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130848256:0@lo:400:kworker.0 00010000:00080000:2.0:1789061927.085007:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f4507800 x1875967130847872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061927.085019:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130847872:0@lo:400:kworker.0 00010000:00080000:2.0:1789061927.085044:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7714380 x1875967130848384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061927.085054:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130848384:0@lo:400:kworker.0 00000100:00100000:3.0:1789061927.085594:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130847104 00000100:00100000:3.0:1789061927.085781:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130847104 00000100:00100000:3.0:1789061927.085838:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789061927.085848:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130847104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061927.085916:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130847104:12345-0@lo:400:kworker.0 Request processed in 70us (3237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061927.085923:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789061927.088407:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130847104:0@lo:400:kworker.0 00000100:00100000:1.0:1789061927.088446:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f4507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130847488:0@lo:400:kworker.0 00000100:00100000:3.0:1789061927.593851:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061927.593873:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130848768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061927.593948:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061927.594031:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130848768 00000100:00100000:3.0:1789061927.594038:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130848768 00000100:00100000:3.0:1789061927.594086:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789061927.594094:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130848768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789061927.594121:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061927.594165:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130848768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061927.594172:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789061927.594721:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061927.594733:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130848896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061927.594767:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.594868:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130848896 00000100:00100000:1.0:1789061927.594885:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130848896 00000100:00100000:1.0:1789061927.594921:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789061927.594928:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130848896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061927.594957:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061927.594990:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130848896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061927.594996:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789061927.595333:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130849024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061927.595365:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061927.595470:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130849024 00000100:00100000:1.0:1789061927.595474:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130849024 00000100:00100000:1.0:1789061927.595503:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789061927.595511:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130849024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789061927.595629:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789061927.595672:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130849024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 162us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061927.595679:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789061927.595718:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130849024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061927.596022:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130848768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789061927.596118:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130848896:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789061927.721756:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061928.745760:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789061928.810572:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789061928.810638:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789061929.772125:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061930.154255:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061930.154278:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130849152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061930.154345:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061930.154472:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130849152 00000100:00100000:0.0:1789061930.154481:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130849152 00000100:00100000:0.0:1789061930.154530:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789061930.154541:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130849152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789061930.154572:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789061930.154653:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130849152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061930.154660:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789061930.154752:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130849152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061930.665926:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130849280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061930.665992:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061930.666185:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130849408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789061930.666230:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061930.666369:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130849280 00000100:00100000:0.0:1789061930.666371:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130849408 00000100:00100000:1.0:1789061930.666377:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130849280 00000100:00100000:0.0:1789061930.666379:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130849408 00000100:00100000:3.0:1789061930.666471:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789061930.666482:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130849280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789061930.666519:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061930.666564:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130849280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061930.666571:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1789061930.666641:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd511880 x1875967130849280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061930.666658:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130849280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061930.672996:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789061930.673012:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130849408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789061930.673052:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061930.673149:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130849408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (6918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061930.673157:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1789061930.673904:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767ffe24a80 x1875967130849408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061930.673936:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130849408:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789061930.681358:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061930.760287:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061930.760399:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061930.760430:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061930.760547:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120274176 00000100:00100000:3.0:1789061930.760557:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120274176 00000100:00100000:3.0:1789061930.760648:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120274048 00000100:00100000:3.0:1789061930.760651:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120274048 00000100:00100000:3.0:1789061930.760677:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 229 00000100:00100000:3.0:1789061930.760687:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120274176:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061930.760760:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120274176:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 75us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061930.760766:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 229 00000100:00100000:3.0:1789061930.760782:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 230 00000100:00100000:3.0:1789061930.760788:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120274048:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061930.760811:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120274048:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061930.760817:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 230 00000100:00100000:1.0:1789061930.761804:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120273920 00000100:00100000:1.0:1789061930.761827:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120273920 00000100:00100000:1.0:1789061930.761894:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 368 00000100:00100000:1.0:1789061930.761902:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120273920:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061930.761962:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120273920:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 61us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061930.761970:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 368 00000100:00080000:0.0:1789061930.767269:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061930.767279:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789061930.770009:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061930.770974:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061930.771072:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061930.771214:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120274432 00000100:00100000:0.0:1789061930.771223:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120274432 00000100:00100000:0.0:1789061930.771291:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120274560 00000100:00100000:0.0:1789061930.771294:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120274560 00000100:00100000:0.0:1789061930.771322:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 231 00000100:00100000:0.0:1789061930.771331:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120274432:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061930.771412:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120274432:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 81us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061930.771419:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 231 00000100:00100000:0.0:1789061930.771437:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 232 00000100:00100000:0.0:1789061930.771443:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120274560:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061930.771468:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120274560:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061930.771473:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 232 00000100:00100000:1.0:1789061930.772498:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120274304 00000100:00100000:1.0:1789061930.772506:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120274304 00000100:00100000:1.0:1789061930.772561:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1789061930.772569:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2389:x1875967120274304:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:1.0:1789061930.772590:0:8412:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6973 00000100:00080000:1.0:1789061930.772600:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9767fd823000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789061930.772674:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1789061930.772809:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+2:2389:x1875967120274304:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 241us (2808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061930.772816:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00080000:1.0:1789061930.772877:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061930.772882:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789061930.772884:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789061930.773011:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061930.793772:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061931.818395:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061932.202302:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130849536:0@lo:400:kworker.0 00000100:00100000:1.0:1789061932.202404:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061932.202478:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130850048:0@lo:400:kworker.0 00000100:00100000:1.0:1789061932.202509:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061932.202532:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130850560:0@lo:400:kworker.0 00000100:00100000:1.0:1789061932.202555:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061932.202586:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c624b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130851072:0@lo:400:kworker.0 00000100:00100000:1.0:1789061932.202643:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061932.202674:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789061932.202681:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130849664:0@lo:400:kworker.0 00000100:00100000:1.0:1789061932.202709:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061932.202726:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130850176:0@lo:400:kworker.0 00000100:00100000:1.0:1789061932.202747:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061932.202762:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130850688:0@lo:400:kworker.0 00000100:00100000:1.0:1789061932.202784:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061932.202819:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130850560 00000100:00100000:1.0:1789061932.202829:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130850560 00000100:00100000:2.0:1789061932.203131:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130849536 00000100:00100000:2.0:1789061932.203138:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130849536 00000100:00100000:3.0:1789061932.203211:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130849792:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.203252:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061932.203277:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130850304:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.203301:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061932.203320:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130850816:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.203341:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061932.203361:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789061932.203366:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130849920:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.203388:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061932.203399:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767f38b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130850432:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.203419:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061932.203438:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c624b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130850944:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.203459:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061932.203490:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130850048 00000100:00100000:3.0:1789061932.203495:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130850048 00000100:00100000:3.0:1789061932.203533:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130849792 00000100:00100000:3.0:1789061932.203535:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130849792 00000100:00100000:3.0:1789061932.203551:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789061932.203559:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130850048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.203642:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130850048:12345-0@lo:400:kworker.0 Request processed in 83us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061932.203649:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789061932.203671:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789061932.203677:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130849792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.203710:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130849792:12345-0@lo:400:kworker.0 Request processed in 33us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061932.203727:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789061932.203748:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130849664 00000100:00100000:3.0:1789061932.203752:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130849664 00000100:00100000:3.0:1789061932.203771:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130850176 00000100:00100000:3.0:1789061932.203774:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130850176 00000100:00100000:3.0:1789061932.203788:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130850688 00000100:00100000:3.0:1789061932.203790:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130850688 00000100:00100000:3.0:1789061932.203801:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130850304 00000100:00100000:3.0:1789061932.203803:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130850304 00000100:00100000:3.0:1789061932.203813:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130850816 00000100:00100000:3.0:1789061932.203815:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130850816 00000100:00100000:3.0:1789061932.203825:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130849920 00000100:00100000:3.0:1789061932.203827:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130849920 00000100:00100000:3.0:1789061932.203838:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789061932.203843:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130849664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.203893:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130849664:12345-0@lo:400:kworker.0 Request processed in 49us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061932.203898:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789061932.203919:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789061932.203925:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130850176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.203952:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130850176:12345-0@lo:400:kworker.0 Request processed in 28us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061932.203957:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789061932.203967:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789061932.203973:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130850688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.203998:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130850688:12345-0@lo:400:kworker.0 Request processed in 25us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061932.204003:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789061932.204021:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789061932.204028:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130850304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.204053:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130850304:12345-0@lo:400:kworker.0 Request processed in 26us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061932.204058:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789061932.204069:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789061932.204073:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130850816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.204098:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130850816:12345-0@lo:400:kworker.0 Request processed in 25us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061932.204104:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789061932.204114:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789061932.204120:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130849920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.204145:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130849920:12345-0@lo:400:kworker.0 Request processed in 26us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061932.204151:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789061932.204170:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130851072 00000100:00100000:3.0:1789061932.204173:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130851072 00000100:00100000:0.0:1789061932.204292:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130850432 00000100:00100000:0.0:1789061932.204296:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130850432 00000100:00100000:3.0:1789061932.206025:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130850944 00000100:00100000:3.0:1789061932.206040:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130850944 00000100:00100000:3.0:1789061932.206100:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789061932.206111:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130850560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.206205:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130850560:12345-0@lo:400:kworker.0 Request processed in 96us (3648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061932.206212:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789061932.206232:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789061932.206239:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130851072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.206307:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130851072:12345-0@lo:400:kworker.0 Request processed in 69us (3662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061932.206314:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789061932.206326:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789061932.206332:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130850944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.206360:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130850944:12345-0@lo:400:kworker.0 Request processed in 28us (2899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061932.206365:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789061932.206439:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130849920:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.206453:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c624b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130850944:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.206466:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130849792:0@lo:400:kworker.0 00010000:00080000:3.0:1789061932.206483:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b4e00 x1875967130850304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061932.206494:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130850304:0@lo:400:kworker.0 00010000:00080000:3.0:1789061932.206506:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b7480 x1875967130850816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061932.206515:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130850816:0@lo:400:kworker.0 00000100:00080000:1.0:1789061932.209024:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061932.209037:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789061932.209040:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061932.209043:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061932.209177:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1789061932.209202:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130849536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061932.209327:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130849536:12345-0@lo:400:kworker.0 Request processed in 138us (6922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061932.209336:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789061932.209636:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130849664:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.209652:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130850176:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.209667:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130850688:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.209677:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130849536:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.209711:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130850048:0@lo:400:kworker.0 00010000:00080000:3.0:1789061932.209727:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b4380 x1875967130850560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061932.209738:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130850560:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.209749:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c624b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130851072:0@lo:400:kworker.0 00000100:00100000:0.0:1789061932.213695:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789061932.213727:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130850432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061932.213855:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130850432:12345-0@lo:400:kworker.0 Request processed in 146us (10433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061932.213863:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1789061932.214188:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767f38b5f80 x1875967130850432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061932.214207:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767f38b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130850432:0@lo:400:kworker.0 00000100:00100000:3.0:1789061932.714427:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061932.714461:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c6248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130851200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061932.714562:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061932.715073:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130851328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061932.715116:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061932.717717:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130851456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061932.717809:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061932.717930:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130851456 00000100:00100000:3.0:1789061932.717950:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130851456 00000100:00100000:3.0:1789061932.718556:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789061932.718567:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130851456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789061932.718868:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789061932.718968:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130851456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 402us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061932.718976:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789061932.719233:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130851456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789061932.723254:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130851200 00000100:00100000:2.0:1789061932.723363:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130851200 00000100:00100000:2.0:1789061932.723432:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130851328 00000100:00100000:2.0:1789061932.723436:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130851328 00000100:00100000:2.0:1789061932.723460:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789061932.723470:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130851200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789061932.723514:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061932.723792:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130851200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 322us (9229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061932.723800:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789061932.723819:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789061932.723827:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130851328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789061932.723839:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061932.723870:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130851328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (8754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061932.723877:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789061932.724146:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c6248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130851200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061932.724195:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130851328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789061932.841967:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061933.866126:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061934.892858:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061935.274558:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130851584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061935.274680:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061935.275107:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130851584 00000100:00100000:2.0:1789061935.275118:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130851584 00000100:00100000:2.0:1789061935.275197:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789061935.275208:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130851584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789061935.275257:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789061935.275322:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130851584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061935.275340:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789061935.275419:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130851584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061935.785960:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130851712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061935.786109:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061935.786340:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130851712 00000100:00100000:0.0:1789061935.786350:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130851712 00000100:00100000:0.0:1789061935.786438:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789061935.786451:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c624bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130851712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061935.786490:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061935.786543:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c624bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130851712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061935.786550:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1789061935.786632:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789061935.786664:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd513480 x1875967130851712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061935.786686:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130851712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061935.789341:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130851840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061935.789444:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061935.789560:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130851840 00000100:00100000:0.0:1789061935.789570:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130851840 00000100:00100000:0.0:1789061935.789680:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789061935.789691:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c6248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130851840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789061935.789721:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789061935.790004:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061935.799912:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c6248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130851840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10205us (10452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061935.799932:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1789061935.803435:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767ffe24e00 x1875967130851840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061935.803473:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130851840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789061935.878028:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061935.878148:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061935.878206:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061935.878248:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061935.878286:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061935.878324:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120274944 00000100:00100000:0.0:1789061935.878336:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120274944 00000100:00100000:3.0:1789061935.878389:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120275200 00000100:00100000:3.0:1789061935.878396:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120275200 00000100:00100000:0.0:1789061935.878411:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120274816 00000100:00100000:0.0:1789061935.878416:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120274816 00000100:00100000:0.0:1789061935.878433:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120275072 00000100:00100000:0.0:1789061935.878443:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120275072 00000100:00100000:0.0:1789061935.878465:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 239 00000100:00100000:0.0:1789061935.878475:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120274944:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061935.878583:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120274944:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 109us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061935.878592:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 239 00000100:00100000:0.0:1789061935.878660:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 240 00000100:00100000:0.0:1789061935.878668:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120274816:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061935.878694:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120274816:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061935.878700:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 240 00000100:00100000:0.0:1789061935.878711:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:0.0:1789061935.878717:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120275072:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061935.878739:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120275072:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061935.878745:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00080000:0.0:1789061935.878763:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061935.878768:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789061935.878899:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00100000:3.0:1789061935.879289:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120275200:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061935.879351:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120275200:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 69us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061935.879909:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120274688 00000100:00100000:1.0:1789061935.879924:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120274688 00000100:00100000:1.0:1789061935.880001:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 370 00000100:00100000:1.0:1789061935.880011:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2393:x1875967120274688:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061935.880063:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2393:x1875967120274688:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 54us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061935.880070:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 370 00000100:00100000:3.0:1789061935.880103:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 242 00010000:00010000:2.0:1789061935.919312:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789061936.811857:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000020:00000080:3.0:1789061936.811868:0:9490:0:(genops.c:885:class_export_put()) final put ffff9767fd824800/8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000020:00000080:0.0:1789061936.811966:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd824800/8b387fcf-29cb-4ebc-866a-7eab61aa3868 for lustre-OST0001 00000020:00000080:0.0:1789061936.812019:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fd823000 for lustre-OST0001 00010000:00010000:1.0:1789061936.938315:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061937.323488:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130851968:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.323554:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061937.323666:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130851968 00000100:00100000:1.0:1789061937.323673:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130851968 00000100:00100000:1.0:1789061937.323724:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789061937.323732:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130851968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061937.323965:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130851968:12345-0@lo:400:kworker.0 Request processed in 234us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061937.323978:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789061937.324049:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130851968:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.324065:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061937.324071:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875967130852352:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.324099:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061937.324136:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130852096:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.324158:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061937.324176:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061937.324182:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130852224:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.324216:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061937.324242:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130852352 00000100:00100000:3.0:1789061937.324246:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130852352 00000100:00100000:3.0:1789061937.324275:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130852096 00000100:00100000:3.0:1789061937.324278:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130852096 00000100:00100000:3.0:1789061937.324297:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789061937.324303:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875967130852352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.324338:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875967130852352:12345-0@lo:400:kworker.0 Request processed in 35us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061937.324345:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789061937.324368:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789061937.324374:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130852096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.324408:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130852096:12345-0@lo:400:kworker.0 Request processed in 34us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061937.324414:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789061937.324432:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130852224 00000100:00100000:3.0:1789061937.324435:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130852224 00000100:00100000:3.0:1789061937.324459:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789061937.324466:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130852224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.324495:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130852224:12345-0@lo:400:kworker.0 Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061937.324501:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789061937.324535:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875967130852352:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.324559:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130852224:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.324567:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130852096:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.324917:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130852480:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.324944:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061937.325115:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130852480 00000100:00100000:1.0:1789061937.325119:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130852480 00000100:00100000:1.0:1789061937.325142:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789061937.325148:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130852480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061937.325959:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130852480:12345-0@lo:400:kworker.0 Request processed in 808us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061937.325968:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789061937.326717:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130852480:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.326741:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130852992:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.326780:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061937.326809:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130853504:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.326829:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061937.326848:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789061937.326854:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130852864:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.326940:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061937.326959:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130853376:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.326979:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061937.327011:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130852736:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327036:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061937.327055:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130853248:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327072:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061937.327088:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789061937.327093:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130852608:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327111:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061937.327125:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130853120:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327142:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061937.327166:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130852992 00000100:00100000:3.0:1789061937.327171:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130852992 00000100:00100000:3.0:1789061937.327284:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130853504 00000100:00100000:3.0:1789061937.327288:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130853504 00000100:00100000:3.0:1789061937.327304:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130852864 00000100:00100000:3.0:1789061937.327307:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130852864 00000100:00100000:3.0:1789061937.327317:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130853376 00000100:00100000:3.0:1789061937.327320:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130853376 00000100:00100000:3.0:1789061937.327333:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789061937.327340:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130852992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327383:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130852992:12345-0@lo:400:kworker.0 Request processed in 43us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061937.327390:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789061937.327403:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789061937.327409:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130853504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327443:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130853504:12345-0@lo:400:kworker.0 Request processed in 35us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061937.327449:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789061937.327461:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789061937.327466:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130852864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327504:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130852864:12345-0@lo:400:kworker.0 Request processed in 37us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061937.327510:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789061937.327520:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789061937.327526:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130853376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327547:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130853376:12345-0@lo:400:kworker.0 Request processed in 22us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061937.327553:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789061937.327572:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130852736 00000100:00100000:3.0:1789061937.327575:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130852736 00000100:00100000:3.0:1789061937.327595:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130853248 00000100:00100000:3.0:1789061937.327597:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130853248 00000100:00100000:3.0:1789061937.327636:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130852608 00000100:00100000:3.0:1789061937.327639:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130852608 00000100:00100000:3.0:1789061937.327650:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130853120 00000100:00100000:3.0:1789061937.327652:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130853120 00000100:00100000:3.0:1789061937.327664:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789061937.327670:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130852736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327702:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130852736:12345-0@lo:400:kworker.0 Request processed in 32us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061937.327707:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789061937.327718:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789061937.327731:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130853248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327757:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130853248:12345-0@lo:400:kworker.0 Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061937.327763:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789061937.327774:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789061937.327779:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130852608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327801:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130852608:12345-0@lo:400:kworker.0 Request processed in 23us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061937.327806:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789061937.327816:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789061937.327821:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130853120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327843:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130853120:12345-0@lo:400:kworker.0 Request processed in 22us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061937.327848:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:3.0:1789061937.327861:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061937.327864:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789061937.327877:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061937.327880:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061937.327917:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130852608:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.327927:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130853120:0@lo:400:kworker.0 00010000:00080000:3.0:1789061937.327939:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c4b64a80 x1875967130852736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061937.327948:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130852736:0@lo:400:kworker.0 00010000:00080000:3.0:1789061937.327957:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c4b64700 x1875967130853248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061937.327977:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130853248:0@lo:400:kworker.0 00010000:00080000:3.0:1789061937.328015:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c4b67100 x1875967130852864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061937.328023:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130852864:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.328032:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130853376:0@lo:400:kworker.0 00010000:00080000:3.0:1789061937.328041:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c4b66a00 x1875967130852992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061937.328049:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130852992:0@lo:400:kworker.0 00000100:00100000:3.0:1789061937.328057:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130853504:0@lo:400:kworker.0 00000100:00100000:1.0:1789061937.834400:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130853632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061937.834478:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061937.834551:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130853632 00000100:00100000:1.0:1789061937.834558:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130853632 00000100:00100000:1.0:1789061937.834600:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789061937.834629:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130853632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789061937.834670:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061937.834712:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130853632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061937.834719:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789061937.834764:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130853632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061937.834996:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130853760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061937.835024:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061937.835049:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130853760 00000100:00100000:0.0:1789061937.835053:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130853760 00000100:00100000:0.0:1789061937.835072:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789061937.835085:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130853760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789061937.835095:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061937.835122:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130853760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061937.835127:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789061937.835152:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130853760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061937.840182:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061937.840202:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130853888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061937.840266:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061937.840319:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130853888 00000100:00100000:3.0:1789061937.840326:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130853888 00000100:00100000:3.0:1789061937.840369:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789061937.840377:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130853888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789061937.840408:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789061937.840653:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130853888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 275us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061937.840661:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789061937.840779:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130853888:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789061937.964638:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789061938.026359:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789061938.042279:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789061938.986645:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061940.009819:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061940.404076:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130854016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061940.404156:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061940.404374:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130854016 00000100:00100000:2.0:1789061940.404383:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130854016 00000100:00100000:2.0:1789061940.404435:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789061940.404444:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130854016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789061940.404476:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789061940.404534:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130854016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061940.404541:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789061940.406272:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130854016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061940.906088:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061940.906111:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130854144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061940.906184:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061940.906297:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130854144 00000100:00100000:0.0:1789061940.906305:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130854144 00000100:00100000:0.0:1789061940.906365:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789061940.906375:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130854144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061940.906401:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061940.906447:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130854144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061940.906454:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1789061940.906522:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789061940.906551:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c4b67800 x1875967130854144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061940.906569:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130854144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061940.906957:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061940.906968:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130854272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061940.907002:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061940.907133:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130854272 00000100:00100000:0.0:1789061940.907138:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130854272 00000100:00100000:0.0:1789061940.907180:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789061940.907187:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c624a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130854272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789061940.907198:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061940.907228:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c624a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130854272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061940.907234:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:2.0:1789061940.907346:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767ffe25500 x1875967130854272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061940.907360:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130854272:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789061940.907437:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061940.998736:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061940.998782:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061940.998853:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061940.998884:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061940.998911:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061940.998980:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120275584 00000100:00100000:2.0:1789061940.998997:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120275584 00000100:00100000:2.0:1789061940.999211:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120275840 00000100:00100000:2.0:1789061940.999216:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120275840 00000100:00100000:2.0:1789061940.999238:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120275456 00000100:00100000:2.0:1789061940.999241:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120275456 00000100:00100000:1.0:1789061940.999389:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120275328 00000100:00100000:1.0:1789061940.999400:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120275328 00000100:00100000:1.0:1789061940.999453:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 372 00000100:00100000:1.0:1789061940.999469:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2392:x1875967120275328:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061940.999472:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120275712 00000100:00100000:2.0:1789061940.999479:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120275712 00000100:00100000:2.0:1789061940.999512:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 249 00000100:00100000:2.0:1789061940.999522:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120275584:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061940.999703:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2392:x1875967120275328:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 237us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061940.999713:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 372 00000100:00100000:3.0:1789061940.999729:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 250 00000100:00100000:3.0:1789061940.999744:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2392:x1875967120275840:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061940.999766:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:1.0:1789061940.999780:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120275456:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061940.999800:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2392:x1875967120275840:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 59us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061940.999809:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 250 00000100:00100000:3.0:1789061940.999837:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 252 00000100:00100000:3.0:1789061940.999854:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2392:x1875967120275712:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061940.999932:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120275456:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 154us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061940.999941:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:2.0:1789061941.000127:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120275584:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 604us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061941.000136:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 249 00000100:00080000:0.0:1789061941.000229:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061941.000236:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789061941.000464:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2392:x1875967120275712:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 617us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061941.000472:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 252 00010000:00010000:2.0:1789061941.034066:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061942.059372:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789061942.155601:0:14035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 13:38:59 (1789061939) 00000100:00100000:0.0:1789061942.445865:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130854784:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.445940:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.445991:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130855296:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446013:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.446031:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767d02b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130855808:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446051:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.446073:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789061942.446079:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130854656:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446101:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.446119:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130855168:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446139:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.446153:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130855680:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446172:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.446200:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130855296 00000100:00100000:0.0:1789061942.446207:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130855296 00000100:00100000:0.0:1789061942.446254:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130855808 00000100:00100000:0.0:1789061942.446257:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130855808 00000100:00100000:0.0:1789061942.446279:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789061942.446287:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130855296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446349:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130855296:12345-0@lo:400:kworker.0 Request processed in 62us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061942.446356:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789061942.446385:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789061942.446391:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130855808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446422:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130855808:12345-0@lo:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061942.446428:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789061942.446450:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130854656 00000100:00100000:0.0:1789061942.446454:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130854656 00000100:00100000:0.0:1789061942.446478:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789061942.446482:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130854528:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446483:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130854656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.446510:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.446512:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130854656:12345-0@lo:400:kworker.0 Request processed in 29us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061942.446518:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789061942.446526:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130855040:0@lo:400:kworker.0 00000100:00080000:0.0:1789061942.446533:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061942.446537:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061942.446545:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.446567:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130854656:0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.446568:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130855552:0@lo:400:kworker.0 00010000:00080000:0.0:1789061942.446581:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c4b65500 x1875967130855296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061942.446588:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.446591:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130855296:0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.446599:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789061942.446600:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767d02b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130855808:0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.446626:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130854400:0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.446651:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.446663:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130854784 00000100:00100000:0.0:1789061942.446667:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130854784 00000100:00100000:1.0:1789061942.446671:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130854912:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446685:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130855168 00000100:00100000:0.0:1789061942.446687:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130855168 00000100:00100000:1.0:1789061942.446699:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.446704:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130855680 00000100:00100000:0.0:1789061942.446706:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130855680 00000100:00100000:1.0:1789061942.446713:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130855424:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446718:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130854528 00000100:00100000:0.0:1789061942.446719:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130854528 00000100:00100000:1.0:1789061942.446733:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.446737:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130855040 00000100:00100000:0.0:1789061942.446740:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130855040 00000100:00100000:1.0:1789061942.446747:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767d02b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130855936:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446752:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130855552 00000100:00100000:0.0:1789061942.446754:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130855552 00000100:00100000:0.0:1789061942.446766:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789061942.446767:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061942.446772:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130854784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.446792:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789061942.446800:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130855168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446803:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130854784:12345-0@lo:400:kworker.0 Request processed in 32us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061942.446809:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789061942.446820:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789061942.446826:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130855168:12345-0@lo:400:kworker.0 Request processed in 28us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061942.446826:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130855680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.446844:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789061942.446859:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789061942.446864:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130854528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446864:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130855680:12345-0@lo:400:kworker.0 Request processed in 38us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061942.446869:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789061942.446879:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789061942.446885:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130855040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.446891:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130854528:12345-0@lo:400:kworker.0 Request processed in 27us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061942.446896:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789061942.446907:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789061942.446907:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130855040:12345-0@lo:400:kworker.0 Request processed in 23us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061942.446912:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130855552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446913:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:0.0:1789061942.446925:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789061942.446928:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061942.446934:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130855552:12345-0@lo:400:kworker.0 Request processed in 22us (345us total) trans 0 rc 0/0 00010000:00080000:0.0:1789061942.446942:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c4b65180 x1875967130855168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061942.446948:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789061942.446951:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130855168:0@lo:400:kworker.0 00010000:00080000:0.0:1789061942.446959:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd345500 x1875967130855680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061942.446966:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130854400 00000100:00100000:1.0:1789061942.446969:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130854400 00000100:00100000:0.0:1789061942.446977:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130855680:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.446990:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130854784:0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.446991:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789061942.446997:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9bf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130854400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.447020:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130855424 00000100:00100000:0.0:1789061942.447024:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130855424 00000100:00100000:0.0:1789061942.447046:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130855936 00000100:00100000:0.0:1789061942.447048:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130855936 00000100:00100000:1.0:1789061942.447049:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9bf3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130854400:12345-0@lo:400:kworker.0 Request processed in 52us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061942.447055:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789061942.447062:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789061942.447067:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130855424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.447089:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130854400:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.447093:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130855424:12345-0@lo:400:kworker.0 Request processed in 27us (360us total) trans 0 rc 0/0 00010000:00080000:1.0:1789061942.447098:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c4b65880 x1875967130855424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789061958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061942.447099:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789061942.447107:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130855424:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.447109:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789061942.447114:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130855936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.447115:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130854528:0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.447123:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130855040:0@lo:400:kworker.0 00000100:00100000:1.0:1789061942.447132:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130855552:0@lo:400:kworker.0 00000100:00100000:0.0:1789061942.447136:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130855936:12345-0@lo:400:kworker.0 Request processed in 22us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061942.447141:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1789061942.447155:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061942.447158:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061942.447160:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767d02b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130855936:0@lo:400:kworker.0 00000100:00100000:2.0:1789061942.447538:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130854912 00000100:00100000:2.0:1789061942.447543:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130854912 00000100:00100000:2.0:1789061942.447576:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789061942.447583:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130854912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061942.447655:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130854912:12345-0@lo:400:kworker.0 Request processed in 71us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061942.447661:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789061942.448224:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130854912:0@lo:400:kworker.0 00000100:00100000:3.0:1789061942.954071:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c751b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130856064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061942.954140:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061942.954358:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130856064 00000100:00100000:1.0:1789061942.954367:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130856064 00000100:00100000:1.0:1789061942.954422:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789061942.954436:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130856064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789061942.954466:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061942.954524:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130856064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061942.954530:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789061942.954634:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c751b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130856064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061942.955235:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130856192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061942.955284:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061942.955516:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130856192 00000100:00100000:3.0:1789061942.955520:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130856192 00000100:00100000:3.0:1789061942.955564:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789061942.955579:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130856192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789061942.955621:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789061942.955663:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130856192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061942.955670:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789061942.955859:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c751aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130856320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061942.955888:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061942.958899:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130856320 00000100:00100000:1.0:1789061942.958915:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130856320 00000100:00100000:1.0:1789061942.959004:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789061942.959015:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130856320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061942.959040:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061942.959124:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130856320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (3235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061942.959131:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789061942.959359:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130856192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061942.959467:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c751aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130856320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789061943.081885:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061943.925848:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061943.926005:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120275968 00000100:00100000:1.0:1789061943.926019:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120275968 00000100:00100000:1.0:1789061943.926107:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:1.0:1789061943.926122:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:11067:x1875967120275968:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061943.926150:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061943.926180:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6a53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b82d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061943.926276:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6a5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061943.926293:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6a5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061943.926309:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6a5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061943.926400:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789061943.926404:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061943.926454:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6a5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061943.926483:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6a53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b82d expref: 7 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061943.926507:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6a5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b82d expref: 6 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061943.926517:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766c15beb00) 00010000:00010000:1.0:1789061943.926521:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789061943.926525:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b800, rc 0) 00000100:00100000:1.0:1789061943.926668:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:11067:x1875967120275968:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 550us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061943.926678:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00080000:0.0:1789061943.927248:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061943.937167:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061943.937320:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120276096 00000100:00100000:2.0:1789061943.937333:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120276096 00000100:00100000:2.0:1789061943.937469:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:2.0:1789061943.937490:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c751aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:11068:x1875967120276096:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061943.937540:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061943.937572:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6a61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.937693:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6a68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.937711:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6a68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.937727:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6a68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.937744:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6a6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.937751:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6a6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.937758:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6a6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.937848:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6a76 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.939741:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6a76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.939779:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6a76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061943.940016:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789061943.940037:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061943.940071:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6a76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940085:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6a68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940092:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6a68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940101:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6a68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940107:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061943.940111:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6a68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940120:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6a68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940135:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766c15beb00) 00010000:00010000:2.0:1789061943.940138:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061943.940145:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6a68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940151:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6a68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940172:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6a6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940177:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6a6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940194:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6a6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940200:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061943.940203:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6a6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940210:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6a6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940218:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9767c72b9000) 00010000:00010000:2.0:1789061943.940220:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061943.940224:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6a6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940230:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6a6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940285:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6a61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b834 expref: 8 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940797:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6a76 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b834 expref: 7 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061943.940806:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9767c72b9800) 00010000:00010000:2.0:1789061943.940809:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061943.940812:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cea00, rc 0) 00000100:00100000:2.0:1789061943.941025:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c751aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:11068:x1875967120276096:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 3543us (3869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061943.941047:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:2.0:1789061943.944039:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061943.949797:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120276224 00000100:00100000:1.0:1789061943.949829:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120276224 00000100:00100000:1.0:1789061943.950171:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1789061943.950185:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c624ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:11068:x1875967120276224:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789061943.950316:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c624ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:11068:x1875967120276224:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 Request processed in 133us (6289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061943.950324:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1789061943.956405:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061943.961517:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120276480 00000100:00100000:2.0:1789061943.961539:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120276480 00000100:00100000:3.0:1789061943.961797:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1789061943.961811:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:11068:x1875967120276480:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061943.961848:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061943.961985:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799400/0x2774d8f311dc6a7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b83b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.962160:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6a84 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.962184:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6a84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.962339:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6a84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968476:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6a8b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968499:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6a8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968530:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6a8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968686:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798200/0x2774d8f311dc6a92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968695:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798200/0x2774d8f311dc6a92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968702:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798200/0x2774d8f311dc6a92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061943.968713:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789061943.968801:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6a84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968809:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6a84 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968815:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6a84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968831:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061943.968836:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6a84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968844:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6a84 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968856:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9767c72b9800) 00010000:00010000:3.0:1789061943.968858:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061943.968870:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6a84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968877:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6a84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968891:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6a8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968898:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6a8b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968905:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6a8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968911:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3798a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061943.968914:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6a8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968920:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6a8b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968929:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9766c7417800) 00010000:00010000:3.0:1789061943.968931:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061943.968933:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6a8b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.968939:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6a8b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.969958:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799400/0x2774d8f311dc6a7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b83b expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.969993:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798200/0x2774d8f311dc6a92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b83b expref: 9 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061943.970001:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c7417500) 00010000:00010000:3.0:1789061943.970004:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061943.970007:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3798200, rc 0) 00000100:00100000:3.0:1789061943.970076:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:11068:x1875967120276480:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 8268us (13687us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789061943.970085:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:0.0:1789061943.975757:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061943.976117:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120276608 00000100:00100000:3.0:1789061943.976127:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120276608 00000100:00100000:3.0:1789061943.976169:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:3.0:1789061943.976177:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:11068:x1875967120276608:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789061943.976292:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:11068:x1875967120276608:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 114us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061943.976299:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:0.0:1789061943.979034:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061943.979257:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120276736 00000100:00100000:2.0:1789061943.979274:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120276736 00000100:00100000:2.0:1789061943.979922:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:2.0:1789061943.979940:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:11068:x1875967120276736:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789061943.984714:0:6498:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4714us 00000100:00080000:0.0:1789061943.986502:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789061944.003815:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:11068:x1875967120276736:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 23865us (24772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061944.003844:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00010000:00010000:2.0:1789061944.106093:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789061944.170411:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789061944.170714:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789061945.133703:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061945.515139:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789061945.517896:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c751b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130856448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061945.517998:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061945.518129:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130856448 00000100:00100000:0.0:1789061945.518140:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130856448 00000100:00100000:0.0:1789061945.518204:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789061945.518215:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c6249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130856448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789061945.518277:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789061945.518338:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c6249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130856448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061945.518346:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789061945.518781:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c751b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130856448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061946.026186:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130856576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061946.026283:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061946.026358:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130856576 00000100:00100000:3.0:1789061946.026369:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130856576 00000100:00100000:3.0:1789061946.026453:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789061946.026465:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c6249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130856576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789061946.026539:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061946.026650:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c6249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130856576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061946.026658:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1789061946.026672:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789061946.027159:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77c1180 x1875967130856576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061946.027182:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130856576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061946.027768:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c751b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130856704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061946.027828:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061946.027886:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130856704 00000100:00100000:1.0:1789061946.027903:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130856704 00000100:00100000:1.0:1789061946.027964:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789061946.027974:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c6249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130856704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789061946.027992:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061946.028036:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c6249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130856704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061946.028042:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:1.0:1789061946.028075:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c751b100 x1875967130856704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789061962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789061946.028078:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061946.028094:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c751b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130856704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061946.122061:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061946.122170:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061946.122209:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061946.122231:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061946.122260:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061946.122294:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120277120 00000100:00100000:1.0:1789061946.122306:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120277120 00000100:00100000:1.0:1789061946.122522:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120277376 00000100:00100000:1.0:1789061946.122527:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120277376 00000100:00100000:1.0:1789061946.122545:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120276992 00000100:00100000:1.0:1789061946.122548:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120276992 00000100:00100000:1.0:1789061946.122559:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120277248 00000100:00100000:1.0:1789061946.122562:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120277248 00000100:00100000:1.0:1789061946.122579:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 259 00000100:00100000:1.0:1789061946.122589:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c751b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120277120:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061946.122703:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c751b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120277120:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 114us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061946.122712:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 259 00000100:00100000:1.0:1789061946.122741:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 260 00000100:00100000:1.0:1789061946.122747:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120277376:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061946.122773:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120277376:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061946.122780:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 260 00000100:00100000:1.0:1789061946.122791:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 261 00000100:00100000:1.0:1789061946.122797:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2393:x1875967120276992:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061946.122831:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2393:x1875967120276992:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061946.122837:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 261 00000100:00100000:1.0:1789061946.122851:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 262 00000100:00100000:1.0:1789061946.122857:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120277248:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061946.125049:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120277248:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 2176us (2772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061946.125065:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 262 00000100:00080000:1.0:1789061946.125116:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061946.125123:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789061946.132716:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120276864 00000100:00100000:0.0:1789061946.132736:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120276864 00000100:00100000:0.0:1789061946.132847:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 374 00000100:00100000:0.0:1789061946.132859:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2393:x1875967120276864:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061946.132989:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2393:x1875967120276864:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 132us (10943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061946.132998:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 374 00010000:00010000:2.0:1789061946.156663:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061946.261989:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061946.262724:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120277504 00000100:00100000:3.0:1789061946.262736:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120277504 00000100:00100000:3.0:1789061946.262825:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:3.0:1789061946.262836:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:11110:x1875967120277504:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789061946.262855:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061946.262876:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6aa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b842 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.262939:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799400/0x2774d8f311dc6aa7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.262953:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799400/0x2774d8f311dc6aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.262964:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799400/0x2774d8f311dc6aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.262986:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6aae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.262994:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263012:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263052:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799400/0x2774d8f311dc6aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263059:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799400/0x2774d8f311dc6aa7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263066:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799400/0x2774d8f311dc6aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263072:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061946.263076:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799400/0x2774d8f311dc6aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263082:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799400/0x2774d8f311dc6aa7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263093:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766c15beb00) 00010000:00010000:3.0:1789061946.263096:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061946.263100:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799400/0x2774d8f311dc6aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263106:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799400/0x2774d8f311dc6aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263118:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263123:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6aae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263135:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263140:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061946.263143:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263149:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6aae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263157:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9766c7415800) 00010000:00010000:3.0:1789061946.263159:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061946.263162:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6aae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263167:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799200/0x2774d8f311dc6aae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263198:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6aa0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b842 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263208:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766c15beb00) 00010000:00010000:3.0:1789061946.263210:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061946.263215:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798a00/0x2774d8f311dc6aa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b842 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.263224:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c3798a00, rc 0) 00000100:00100000:3.0:1789061946.263276:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:11110:x1875967120277504:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 441us (1295us total) trans 0 rc 301/301 00000100:00100000:3.0:1789061946.263292:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:0.0:1789061946.272251:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061946.272330:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120277760 00000100:00100000:3.0:1789061946.272339:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120277760 00000100:00100000:3.0:1789061946.272401:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:3.0:1789061946.272411:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:11110:x1875967120277760:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:3.0:1789061946.272465:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061946.272491:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6a5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b82d expref: 9 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.272509:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766c15beb00) 00010000:00010000:3.0:1789061946.272521:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061946.272575:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6ab5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.272588:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.272597:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.272635:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc6abc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.272643:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc6abc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.272650:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc6abc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273126:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc6ac3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273141:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc6ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273149:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc6ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061946.273165:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c7d904a reply state 0000000011d72dfe transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc6ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273176:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc6ac3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273183:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:3.0:1789061946.273186:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789061946.273188:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789061946.273193:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789061946.273199:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273207:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6ab5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273214:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6ab5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273220:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061946.273224:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6ab5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273231:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6ab5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273250:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061946.273252:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061946.273256:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6ab5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273261:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799000/0x2774d8f311dc6ab5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061946.273275:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c7d904a reply state 0000000011d72dfe transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc6abc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273283:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc6abc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.273289:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9766c7415900) 00010000:00010000:3.0:1789061946.273292:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789061946.273294:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789061946.273386:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:11110:x1875967120277760:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 975us (1142us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789061946.273394:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:1.0:1789061946.389303:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061946.389396:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120277888 00000100:00100000:2.0:1789061946.389406:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120277888 00000100:00100000:2.0:1789061946.389464:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:2.0:1789061946.389475:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:11118:x1875967120277888:12345-192.168.203.3@tcp:101:lctl.0 00010000:00010000:2.0:1789061946.389512:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061946.389535:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6aca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b849 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.389602:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc6ad1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.389736:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc6ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.389824:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc6ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061946.389871:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789061946.389874:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061946.389910:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc6ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.389933:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6aca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b849 expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.389952:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc6ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b849 expref: 11 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.389959:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fd592800) 00010000:00010000:2.0:1789061946.389961:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061946.389965:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cf000, rc 0) 00000100:00100000:2.0:1789061946.390054:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:11118:x1875967120277888:12345-192.168.203.3@tcp:101:lctl.0 Request processed in 581us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061946.390061:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:3.0:1789061946.464819:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061946.464964:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120278016 00000100:00100000:0.0:1789061946.464979:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120278016 00000100:00100000:0.0:1789061946.465059:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:0.0:1789061946.465069:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:11124:x1875967120278016:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1789061946.465089:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061946.465107:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6ad8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b850 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465186:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6adf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465200:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465212:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465223:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6ae6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465230:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465236:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465316:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6aed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465330:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6aed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465337:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6aed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061946.465378:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789061946.465383:0:8435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789061946.465420:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6aed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465442:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465447:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6adf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465453:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6adf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465457:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061946.465461:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6adf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465466:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6adf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465476:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fd592800) 00010000:00010000:0.0:1789061946.465479:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061946.465482:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465487:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465499:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465504:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465508:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465529:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061946.465532:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465537:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465543:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9766c7415900) 00010000:00010000:0.0:1789061946.465545:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061946.465547:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6ae6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465552:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6ae6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465575:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6ad8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b850 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465586:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6aed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b850 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.465592:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061946.465593:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789061946.465595:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030c00, rc 0) 00000100:00100000:0.0:1789061946.465718:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+12:11124:x1875967120278016:12345-192.168.203.3@tcp:101:bash.0 Request processed in 650us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061946.465725:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:0.0:1789061946.474109:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061946.474431:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120278272 00000100:00100000:1.0:1789061946.474441:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120278272 00000100:00100000:1.0:1789061946.474547:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:1.0:1789061946.474558:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+12:11124:x1875967120278272:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1789061946.474578:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061946.474598:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6af4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b857 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.474729:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6afb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.474745:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6afb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.474767:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6afb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.474784:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6b02 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.474791:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6b02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.474798:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6b02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789061946.475407:0:10077:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789061946.475535:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6b09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475546:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475554:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475584:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6afb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475603:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6afb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475634:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6afb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475640:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47be00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061946.475644:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6afb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475652:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6afb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475664:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:1.0:1789061946.475667:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061946.475671:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6afb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475678:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6afb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789061946.475692:0:10077:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000265ac653 reply state 00000000a7df9431 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6b02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475703:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6b02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475709:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9766c15bea00) 00010000:00010000:1.0:1789061946.475712:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789061946.475715:0:10077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789061946.475742:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6af4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b857 expref: 15 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475763:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b857 expref: 14 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.475771:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c15be200) 00010000:00010000:1.0:1789061946.475773:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061946.475775:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a200, rc 0) 00000100:00100000:1.0:1789061946.475857:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:11124:x1875967120278272:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1300us (1756us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789061946.475864:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:0.0:1789061946.479429:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061946.479655:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120278400 00000100:00100000:2.0:1789061946.479666:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120278400 00000100:00100000:2.0:1789061946.479714:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:2.0:1789061946.479722:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875967120278400:12345-192.168.203.3@tcp:8:bash.0 00010000:00080000:2.0:1789061946.479799:0:8411:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:2.0:1789061946.479843:0:8411:0:(genops.c:1384:class_connect()) connect: client 8b387fcf-29cb-4ebc-866a-7eab61aa3868, cookie 0x2774d8f311dc6b17 00002000:00100000:2.0:1789061946.479854:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8b387fcf-29cb-4ebc-866a-7eab61aa3868/ffff9766c809b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789061946.479865:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:2.0:1789061946.479937:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789061946.479965:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9766c809b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789061946.480093:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2389:x1875967120278400:12345-192.168.203.3@tcp:8:bash.0 Request processed in 368us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061946.480100:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:0.0:1789061946.499566:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061946.499877:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120278528 00000100:00100000:2.0:1789061946.499892:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120278528 00000100:00100000:2.0:1789061946.500035:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:2.0:1789061946.500049:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:0:x1875967120278528:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1789061946.500072:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061946.500105:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a900fc98/0x2774d8f311dc6b1e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b85e expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789061946.500140:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789061946.500163:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:2.0:1789061946.500168:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061946.500190:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a900fc98/0x2774d8f311dc6b1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b85e expref: 7 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.500250:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a900fc98/0x2774d8f311dc6b1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b85e expref: 7 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.500267:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce200, rc 0) 00000100:00100000:2.0:1789061946.500341:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:0:x1875967120278528:12345-192.168.203.3@tcp:101:bash.0 Request processed in 296us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061946.500350:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00080000:1.0:1789061946.501671:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061946.506515:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061946.506992:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120278656 00000100:00100000:3.0:1789061946.507067:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120278656 00000100:00100000:3.0:1789061946.507153:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1789061946.507165:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:11124:x1875967120278656:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1789061946.507192:0:8613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061946.507584:0:8613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b865 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.507726:0:8613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a900fc98/0x2774d8f311dc6b1e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b85e expref: 8 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.507737:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061946.507743:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061946.507749:0:8613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 8 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.507798:0:8613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a900fc98/0x2774d8f311dc6b1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b85e expref: 8 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.507826:0:8613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a900fc98/0x2774d8f311dc6b1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b85e expref: 8 pid: 8413 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061946.507845:0:8613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8613:1875967130856832:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061946.507987:0:8613:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd481c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789061946.512107:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061946.512350:0:8613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8613:1875967130856832:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061946.512393:0:8613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 8 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.512417:0:8613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807ba00, rc 0) 00000100:00100000:3.0:1789061946.512486:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:11124:x1875967120278656:12345-192.168.203.3@tcp:101:bash.0 Request processed in 5322us (5987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061946.512495:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:1.0:1789061946.512659:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120278784 00000100:00100000:1.0:1789061946.512668:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120278784 00010000:00010000:1.0:1789061946.512715:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a900fc98/0x2774d8f311dc6b1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b85e expref: 8 pid: 8413 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061946.512749:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:1.0:1789061946.512759:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120278784:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061946.512774:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061946.512800:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a900fc98/0x2774d8f311dc6b1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b85e expref: 8 pid: 8413 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.512824:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a900fc98/0x2774d8f311dc6b1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b85e expref: 8 pid: 8413 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.512852:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a900fc98/0x2774d8f311dc6b1e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b85e expref: 8 pid: 8413 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.512878:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061946.512883:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061946.512892:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 7 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.512902:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 7 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.512951:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 7 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061946.512967:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c76c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6480:1875967130856960:192.168.203.3@tcp:105: 00000100:00100000:1.0:1789061946.513037:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1238cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061946.519259:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061946.519399:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c76c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6480:1875967130856960:192.168.203.3@tcp:105: 00010000:00010000:1.0:1789061946.519431:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061946.519506:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2392:x1875967120278784:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 6748us (7412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061946.519520:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:2.0:1789061946.520130:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120279040 00000100:00100000:2.0:1789061946.520142:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120279040 00000100:00100000:2.0:1789061946.520210:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1789061946.520228:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:11124:x1875967120279040:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:2.0:1789061946.520593:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:11124:x1875967120279040:12345-192.168.203.3@tcp:35:bash.0 Request processed in 372us (1350us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789061946.520600:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:0.0:1789061946.625673:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061946.625897:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120279296 00000100:00100000:2.0:1789061946.625912:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120279296 00000100:00100000:2.0:1789061946.625989:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:2.0:1789061946.626002:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:11134:x1875967120279296:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061946.626035:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061946.626064:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b86c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061946.626323:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789061946.626914:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b86c expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.626951:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fd592800) 00010000:00010000:2.0:1789061946.626955:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061946.626962:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b86c expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.626982:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce600, rc 0) 00000100:00100000:2.0:1789061946.627056:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:11134:x1875967120279296:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1057us (1454us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1789061946.627065:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1789061946.633021:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061946.633174:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120279552 00000100:00100000:1.0:1789061946.633200:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120279552 00000100:00100000:1.0:1789061946.633278:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1789061946.633291:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:11134:x1875967120279552:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:1.0:1789061946.633983:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:11134:x1875967120279552:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 690us (973us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789061946.634013:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1789061946.741558:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061946.742153:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120279680 00000100:00100000:3.0:1789061946.742167:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120279680 00000100:00100000:3.0:1789061946.742261:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:3.0:1789061946.742273:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:11140:x1875967120279680:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789061946.742317:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061946.742345:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6b3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b873 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.742474:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc6b41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.742493:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc6b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.742506:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc6b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061946.742560:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789061946.742565:0:8435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789061946.742589:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc6b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.742649:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6b3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b873 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.742673:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc6b41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b873 expref: 19 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.743070:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:3.0:1789061946.743076:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789061946.743090:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807b200, rc 0) 00000100:00100000:3.0:1789061946.743244:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:11140:x1875967120279680:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 971us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061946.743252:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:0.0:1789061946.749087:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061946.749209:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120279936 00000100:00100000:1.0:1789061946.749225:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120279936 00000100:00100000:1.0:1789061946.749346:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:1.0:1789061946.749360:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:11140:x1875967120279936:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061946.749389:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061946.749667:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6b48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b87a expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.749846:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6b4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.749864:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.749880:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061946.749894:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789061946.750043:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6b48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b87a expref: 22 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.750068:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6b4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b87a expref: 21 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.750079:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c15be200) 00010000:00010000:1.0:1789061946.750082:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061946.750087:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b800, rc 0) 00000100:00100000:1.0:1789061946.750365:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:11140:x1875967120279936:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 819us (1104us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789061946.750375:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:0.0:1789061946.755602:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061946.755757:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061946.755957:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120280320 00000100:00100000:3.0:1789061946.755971:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120280320 00000100:00100000:3.0:1789061946.756048:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:3.0:1789061946.756061:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:2392:x1875967120280320:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061946.756081:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061946.756114:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6b4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b87a expref: 21 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.756139:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c15be200) 00010000:00010000:3.0:1789061946.756146:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061946.756223:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:2392:x1875967120280320:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 165us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061946.756232:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:1.0:1789061946.756371:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120280192 00000100:00100000:1.0:1789061946.756376:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120280192 00000100:00100000:1.0:1789061946.756428:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:1.0:1789061946.756436:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:11140:x1875967120280192:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061946.756462:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061946.756480:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6b5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b881 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.756627:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6b64 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.756644:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6b64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.756657:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6b64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061946.756673:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789061946.756984:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6b5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b881 expref: 23 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.757003:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6b64 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b881 expref: 22 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.757012:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c15be200) 00010000:00010000:1.0:1789061946.757015:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789061946.757038:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a800, rc 0) 00000100:00100000:1.0:1789061946.757078:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:11140:x1875967120280192:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 642us (1491us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789061946.757085:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:0.0:1789061946.763799:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061946.763980:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120280448 00000100:00100000:2.0:1789061946.763993:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120280448 00000100:00100000:2.0:1789061946.764063:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:2.0:1789061946.764075:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2393:x1875967120280448:12345-192.168.203.3@tcp:1:lfs.0 00010000:00010000:2.0:1789061946.764140:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.764168:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 7 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.764282:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061946.764289:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061946.764295:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.764343:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 7 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.764380:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 7 pid: 8613 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061946.764407:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c6248e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8413:1875967130857088:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061946.764514:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061946.767544:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c6248e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8413:1875967130857088:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061946.767584:0:8413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061946.771698:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061946.772267:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120280576 00000100:00100000:1.0:1789061946.772277:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120280576 00002000:00100000:1.0:1789061946.772323:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9767c4b64e00 x1875967120280576/t0(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:367/0 lens 504/0 e 0 to 0 dl 1789061957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789061946.772334:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9767c4b64e00 with x1875967120280576 ext(0->12) 00010000:00010000:1.0:1789061946.772343:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 8 pid: 8613 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061946.772360:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 8 pid: 8613 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061946.772367:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9767c4b64e00 00000100:00100000:1.0:1789061946.772564:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:1.0:1789061946.772574:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2390:x1875967120280576:12345-192.168.203.3@tcp:4:lfs.0 00000001:00100000:1.0:1789061946.783671:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000100:00100000:3.0:1789061946.787037:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2390:x1875967120280576:12345-192.168.203.3@tcp:4:lfs.0 Request processed in 14447us (15332us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789061946.787062:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00002000:00100000:3.0:1789061946.787079:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9767c4b64e00 x1875967120280576/t4294967300(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:367/0 lens 504/448 e 0 to 0 dl 1789061957 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789061946.787090:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9767c4b64e00 with x1875967120280576 ext(0->12) 00010000:00010000:3.0:1789061946.787104:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 9 pid: 8613 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.787152:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 9 pid: 8613 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061946.787161:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9767c4b64e00 00000100:00100000:0.0:1789061946.796853:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061946.797011:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120280704 00000100:00100000:2.0:1789061946.797026:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120280704 00010000:00010000:2.0:1789061946.797080:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 9 pid: 8613 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061946.797135:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1789061946.797147:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2391:x1875967120280704:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061946.797165:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789061946.797201:0:6481:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789061946.797204:0:6481:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789061945 00002000:00010000:2.0:1789061946.797208:0:6481:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789061945 00002000:00010000:2.0:1789061946.797210:0:6481:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789061945 00002000:00010000:2.0:1789061946.797213:0:6481:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789061946.797220:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 9 pid: 8613 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.797261:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 9 pid: 8613 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.797291:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e218913/0x2774d8f311dc6b25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b865 expref: 9 pid: 8613 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.797312:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061946.797317:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061946.797324:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.797336:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.797376:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061946.797462:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2391:x1875967120280704:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 316us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061946.797471:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00010000:00010000:0.0:1789061946.798297:0:8413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.798312:0:8413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.798346:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.798356:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.798366:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.798582:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789061946.798589:0:8413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.798599:0:8413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.799046:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.799056:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f03f1df/0x2774d8f311dc6b72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061946.799218:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2393:x1875967120280448:12345-192.168.203.3@tcp:1:lfs.0 Request processed in 35141us (35431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061946.799228:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:0.0:1789061946.804067:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061946.804168:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120280960 00000100:00100000:1.0:1789061946.804245:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120280960 00000100:00100000:1.0:1789061946.804878:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:1.0:1789061946.804896:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:11140:x1875967120280960:12345-192.168.203.3@tcp:35:lfs.0 00000004:00010000:1.0:1789061946.804985:0:6500:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6b64 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b881 expref: 22 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789061946.805598:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1789061946.807923:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789061946.809082:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1789061946.809147:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.809174:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6b09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b857 expref: 26 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.809259:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.809474:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b857 expref: 26 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.809497:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6b09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b857 expref: 26 pid: 10077 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061946.809516:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c6248e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6500:1875967130857216:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061946.809724:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061946.813635:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061946.814093:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120281088 00000100:00100000:3.0:1789061946.814106:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120281088 00010000:00010000:3.0:1789061946.814159:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6b09 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b857 expref: 27 pid: 10077 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061946.814217:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:3.0:1789061946.814230:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:2393:x1875967120281088:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061946.814249:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061946.814256:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6b09 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b857 expref: 27 pid: 10077 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.814272:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6b09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b857 expref: 27 pid: 10077 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.814312:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c15be200) 00010000:00010000:3.0:1789061946.814319:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.814331:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.814340:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.814383:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061946.814471:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:2393:x1875967120281088:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 242us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061946.814480:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00010000:00010000:2.0:1789061946.815987:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6b09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b857 expref: 26 pid: 10077 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061946.816017:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c6248e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6500:1875967130857216:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061946.816048:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.816061:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.816067:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789061946.816281:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1789061946.816576:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789061946.817118:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c6248e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1875967130857344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789061946.817210:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061946.817256:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061946.817516:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130857344 00000100:00100000:3.0:1789061946.817526:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130857344 00000100:00100000:3.0:1789061946.817597:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789061946.817634:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c6249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6500:x1875967130857344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789061946.817928:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c6249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6500:x1875967130857344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 320us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061946.817938:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789061946.818037:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c6248e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1875967130857344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789061946.818276:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1789061946.818343:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c6248e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1875967130857472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789061946.818378:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061946.818505:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061946.819071:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130857472 00000100:00100000:3.0:1789061946.819081:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130857472 00000100:00100000:2.0:1789061946.819311:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789061946.819321:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c6248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6500:x1875967130857472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789061946.819585:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c6248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6500:x1875967130857472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 265us (1205us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789061946.819593:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789061946.819713:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c6248e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1875967130857472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789061946.819783:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1789061946.819842:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.819854:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.819862:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.819869:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061946.819874:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.819898:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.819917:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c15be200) 00010000:00010000:3.0:1789061946.819921:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789061946.819927:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.819934:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc6b79 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789061946.820064:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789061946.820146:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789061946.820160:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327929553476ns, next at 328929550821ns, rc = 0 00000001:00080000:3.0:1789061946.820167:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1789061946.820205:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c15be200) 00010000:00010000:3.0:1789061946.820208:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789061946.820217:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6b64 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b881 expref: 30 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061946.820352:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:11140:x1875967120280960:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 15463us (16299us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1789061946.820362:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000020:00080000:3.0:1789061946.820366:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789061946.824474:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061946.824631:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120281216 00000100:00100000:3.0:1789061946.824643:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120281216 00000100:00100000:3.0:1789061946.824730:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:3.0:1789061946.824742:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:11140:x1875967120281216:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789061946.824793:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061946.824831:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6b80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b888 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.824910:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6b80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b888 expref: 30 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.824929:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6b80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b888 expref: 30 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061946.824951:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061946.824955:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061946.824960:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807b600, rc 0) 00000100:00100000:3.0:1789061946.825033:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:11140:x1875967120281216:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 294us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061946.825041:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:0.0:1789061946.828792:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061946.828989:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120281472 00000100:00100000:3.0:1789061946.829004:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120281472 00000100:00100000:3.0:1789061946.829081:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1789061946.829093:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:11140:x1875967120281472:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1789061946.829818:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+31:11140:x1875967120281472:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 723us (1035us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789061946.829827:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:1.0:1789061946.924163:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061946.924553:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120281728 00000100:00100000:0.0:1789061946.924567:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120281728 00000100:00100000:0.0:1789061946.924679:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:0.0:1789061946.924702:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+31:11150:x1875967120281728:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061946.924738:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061946.924793:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b88f expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061946.924942:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789061946.925542:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6b87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b88f expref: 33 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.925560:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fd592800) 00010000:00010000:0.0:1789061946.925563:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789061946.925570:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b88f expref: 33 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061946.925591:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030e00, rc 0) 00000100:00100000:0.0:1789061946.925940:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:11150:x1875967120281728:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1249us (1790us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1789061946.925949:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:0.0:1789061946.935386:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061946.940107:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120281856 00000100:00100000:2.0:1789061946.940132:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120281856 00000100:00100000:2.0:1789061946.940593:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:2.0:1789061946.940640:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:11150:x1875967120281856:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:2.0:1789061946.940758:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6b95 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.940782:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6b95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.940809:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6b95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.940825:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6b9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.940833:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.940841:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.940961:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6ba3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.940971:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.940978:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061946.941053:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941069:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6b95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941076:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6b95 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941083:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6b95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941089:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061946.941094:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6b95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941103:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6b95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941115:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:2.0:1789061946.941119:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061946.941125:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6b95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941139:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6b95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941157:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941164:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6b9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941168:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6b9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941173:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cee00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061946.941186:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6b9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941193:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6b9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941200:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9766c15bea00) 00010000:00010000:2.0:1789061946.941203:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061946.941206:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6b9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941211:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6b9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941227:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941234:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941246:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941251:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061946.941254:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941260:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941269:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061946.941272:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061946.941275:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6ba3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061946.941281:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6ba3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061946.941389:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:11150:x1875967120281856:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 783us (6018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061946.941405:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:3.0:1789061946.949189:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061946.949432:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120282112 00000100:00100000:1.0:1789061946.949446:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120282112 00000100:00100000:1.0:1789061946.949526:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:1.0:1789061946.949540:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:11150:x1875967120282112:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:1.0:1789061946.953886:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+33:11150:x1875967120282112:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 4331us (4704us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789061946.953906:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:1.0:1789061947.006293:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061947.006537:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120282368 00000100:00100000:0.0:1789061947.006550:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120282368 00000100:00100000:0.0:1789061947.006663:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:0.0:1789061947.006675:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+33:11153:x1875967120282368:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061947.008908:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061947.008953:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6baa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.009073:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6bb1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.009091:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.009124:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.009138:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6bb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.009145:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.009152:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.010205:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6bbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.010344:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6bbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.010356:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6bbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061947.010373:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789061947.011443:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011456:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6bb1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011464:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011471:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061947.011491:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011501:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6bb1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011517:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061947.011521:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061947.011526:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6bb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011534:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6bb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011551:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011558:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6bb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011563:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011569:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061947.011572:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011578:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011586:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9766c15bea00) 00010000:00010000:0.0:1789061947.011588:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061947.011599:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6bb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011659:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6bb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011734:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6baa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b896 expref: 36 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011753:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6bbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b896 expref: 35 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.011761:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:0.0:1789061947.011763:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061947.011766:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613fa00, rc 0) 00000100:00100000:0.0:1789061947.011875:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+35:11153:x1875967120282368:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 5201us (6208us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789061947.011885:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:0.0:1789061947.015977:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061947.020338:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120282496 00000100:00100000:3.0:1789061947.020359:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120282496 00000100:00100000:3.0:1789061947.020696:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:3.0:1789061947.020730:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+35:11153:x1875967120282496:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:3.0:1789061947.020846:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6bcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.020871:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.020889:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.020934:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6bcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.020941:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6bcd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.020949:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6bcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.020955:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061947.020960:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6bcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.020968:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6bcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.020980:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061947.020983:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061947.020988:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6bcd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.020994:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6bcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061947.021896:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+35:11153:x1875967120282496:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 1164us (5929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061947.021906:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:2.0:1789061947.031216:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061947.031526:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120282752 00000100:00100000:3.0:1789061947.031539:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120282752 00000100:00100000:3.0:1789061947.031632:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1789061947.031645:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c624b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+35:11153:x1875967120282752:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1789061947.033553:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c624b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+36:11153:x1875967120282752:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 1901us (2342us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789061947.033566:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00010000:00010000:2.0:1789061947.181255:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061947.439507:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061947.439768:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120283008 00000100:00100000:2.0:1789061947.439780:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120283008 00000100:00100000:2.0:1789061947.439863:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:2.0:1789061947.439874:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+36:11183:x1875967120283008:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:2.0:1789061947.439907:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061947.439936:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6bd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b89d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.440138:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6bdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.440160:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6bdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.440173:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6bdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061947.440185:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789061947.440364:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6bd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b89d expref: 39 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.440400:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6bdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b89d expref: 38 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.440409:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061947.440413:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061947.440417:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce400, rc 0) 00000100:00100000:2.0:1789061947.440568:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:11183:x1875967120283008:12345-192.168.203.3@tcp:101:cat.0 Request processed in 695us (1077us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789061947.440576:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1789061947.451901:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061947.452586:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120283264 00000100:00100000:2.0:1789061947.452600:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120283264 00000100:00100000:2.0:1789061947.452815:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:2.0:1789061947.452828:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:11183:x1875967120283264:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:2.0:1789061947.453137:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+39:11183:x1875967120283264:12345-192.168.203.3@tcp:35:cat.0 Request processed in 311us (1249us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789061947.453164:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:0.0:1789061947.462040:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061947.462331:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120283392 00000100:00100000:1.0:1789061947.462345:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120283392 00000100:00100000:1.0:1789061947.462430:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:1.0:1789061947.462444:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+39:2393:x1875967120283392:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061947.462464:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061947.462497:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc6bdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b89d expref: 39 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061947.462523:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061947.462529:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061947.462600:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:2393:x1875967120283392:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 160us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061947.462644:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:1.0:1789061947.554005:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061947.554154:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120283648 00000100:00100000:0.0:1789061947.554168:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120283648 00000100:00100000:0.0:1789061947.554369:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:0.0:1789061947.554391:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:11190:x1875967120283648:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:0.0:1789061947.554424:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061947.554428:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789061947.554463:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc6b41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b873 expref: 38 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.554503:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061947.554509:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061947.554528:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6be9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.554757:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.554773:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6bbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b896 expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.554781:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.554855:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6bbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b896 expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061947.554872:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6bbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b896 expref: 38 pid: 6498 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061947.554890:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1875967130857600:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061947.555021:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789061947.561968:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130858112:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562063:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562113:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130858624:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562142:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562159:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130859136:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562185:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562216:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789061947.562232:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130857728:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562267:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562300:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130858240:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562326:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562343:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130858752:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562363:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562392:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130859264:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562412:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562440:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130857856:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562468:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562488:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130858368:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562510:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562524:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130858880:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562545:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562561:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789061947.562567:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130857984:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562592:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562675:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130858496:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562699:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562710:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130859008:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562730:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061947.562756:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130857728 00000100:00100000:1.0:1789061947.562766:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130857728 00000100:00100000:1.0:1789061947.562833:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789061947.562844:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130857728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.562907:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130857728:12345-0@lo:400:kworker.0 Request processed in 64us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061947.562916:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789061947.562956:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130858240 00000100:00100000:1.0:1789061947.562959:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130858240 00000100:00100000:1.0:1789061947.562981:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130857984 00000100:00100000:1.0:1789061947.562984:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130857984 00000100:00100000:1.0:1789061947.562998:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789061947.563005:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130858240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563039:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130858240:12345-0@lo:400:kworker.0 Request processed in 35us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061947.563045:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789061947.563056:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789061947.563063:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130857984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563093:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130857984:12345-0@lo:400:kworker.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061947.563098:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789061947.563140:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130857984:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563184:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130857728:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563194:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130858240:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563217:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130858112 00000100:00100000:1.0:1789061947.563221:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130858112 00000100:00100000:1.0:1789061947.563241:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130857856 00000100:00100000:1.0:1789061947.563244:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130857856 00000100:00100000:1.0:1789061947.563254:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130858368 00000100:00100000:1.0:1789061947.563257:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130858368 00000100:00080000:1.0:1789061947.563281:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061947.563297:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130858880 00000100:00100000:1.0:1789061947.563300:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130858880 00000100:00080000:1.0:1789061947.563312:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061947.563324:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130858496 00000100:00100000:1.0:1789061947.563327:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130858496 00000100:00080000:1.0:1789061947.563337:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061947.563347:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130859008 00000100:00100000:1.0:1789061947.563350:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130859008 00000100:00080000:1.0:1789061947.563361:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061947.563376:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789061947.563382:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130858112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563420:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130858112:12345-0@lo:400:kworker.0 Request processed in 38us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061947.563426:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789061947.563452:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130858112:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563470:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789061947.563477:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130857856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563511:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130857856:12345-0@lo:400:kworker.0 Request processed in 35us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061947.563524:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789061947.563547:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130857856:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563565:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789061947.563572:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130858368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563633:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130858368:12345-0@lo:400:kworker.0 Request processed in 36us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061947.563639:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789061947.563664:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130858368:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563682:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789061947.563689:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130858880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563722:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130858880:12345-0@lo:400:kworker.0 Request processed in 34us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061947.563728:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789061947.563750:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130858880:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563767:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789061947.563773:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130858496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563816:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130858496:12345-0@lo:400:kworker.0 Request processed in 43us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061947.563822:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00010000:00080000:1.0:1789061947.563849:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c8f7c380 x1875967130858496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061947.563861:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130858496:0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563888:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789061947.563895:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130859008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061947.563927:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130859008:12345-0@lo:400:kworker.0 Request processed in 33us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061947.563934:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00080000:1.0:1789061947.563956:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c8f7d500 x1875967130859008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061947.563967:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130859008:0@lo:400:kworker.0 00000100:00100000:0.0:1789061947.564345:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130858624 00000100:00100000:0.0:1789061947.564352:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130858624 00000100:00100000:0.0:1789061947.564392:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130859136 00000100:00100000:0.0:1789061947.564396:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130859136 00000100:00100000:0.0:1789061947.564416:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130858752 00000100:00100000:0.0:1789061947.564419:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130858752 00000100:00100000:0.0:1789061947.564442:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130859264 00000100:00100000:0.0:1789061947.564446:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130859264 00000100:00100000:0.0:1789061947.564462:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789061947.564468:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130858624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061947.564517:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130858624:12345-0@lo:400:kworker.0 Request processed in 50us (2374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061947.564524:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789061947.564539:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789061947.564545:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130859136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061947.564576:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130859136:12345-0@lo:400:kworker.0 Request processed in 31us (2394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061947.564581:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789061947.564592:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789061947.564598:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875967130858752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061947.564645:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875967130858752:12345-0@lo:400:kworker.0 Request processed in 47us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061947.564651:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789061947.564662:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789061947.564669:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130859264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061947.564710:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130859264:12345-0@lo:400:kworker.0 Request processed in 41us (2296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061947.564716:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789061947.564752:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130858752:0@lo:400:kworker.0 00000100:00100000:0.0:1789061947.564764:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130859264:0@lo:400:kworker.0 00000100:00100000:0.0:1789061947.564777:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130858624:0@lo:400:kworker.0 00000100:00100000:0.0:1789061947.564809:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130859136:0@lo:400:kworker.0 00000100:00080000:1.0:1789061947.565314:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061947.568003:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1875967130857600:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061947.568046:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061947.574781:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061947.575124:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120283776 00000100:00100000:3.0:1789061947.575138:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120283776 00010000:00010000:3.0:1789061947.575206:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6bbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b896 expref: 39 pid: 6498 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061947.575255:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:3.0:1789061947.575268:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+39:2393:x1875967120283776:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061947.575287:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061947.575296:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6bbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b896 expref: 39 pid: 6498 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.575326:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6bbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b896 expref: 39 pid: 6498 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.575353:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6bbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b896 expref: 39 pid: 6498 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.575536:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061947.575543:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.575553:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.575562:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.575659:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061947.575813:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:2393:x1875967120283776:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 546us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061947.575823:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00010000:00010000:1.0:1789061947.577969:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061947.577988:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061947.578018:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789061947.578263:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6be9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8a4 expref: 39 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061947.578303:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8a4 expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061947.578314:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061947.578317:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789061947.578321:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613e800, rc 0) 00000100:00100000:1.0:1789061947.578537:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:11190:x1875967120283648:12345-192.168.203.3@tcp:101:dd.0 Request processed in 24148us (24544us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789061947.578564:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:1.0:1789061947.583120:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061947.583299:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120283904 00000100:00100000:2.0:1789061947.583313:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120283904 00000100:00100000:2.0:1789061947.583392:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:2.0:1789061947.583404:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:11190:x1875967120283904:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1789061947.583436:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061947.583464:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6bfe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8ab expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.583512:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6c05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.583529:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6c05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.583544:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6c05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.583853:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6bfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ab expref: 40 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.583877:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6c05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ab expref: 39 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.583886:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061947.583890:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789061947.583894:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce000, rc 0) 00000100:00100000:2.0:1789061947.584023:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+39:11190:x1875967120283904:12345-192.168.203.3@tcp:101:dd.0 Request processed in 621us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061947.584041:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:0.0:1789061947.594046:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061947.595464:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120284160 00000100:00100000:3.0:1789061947.595484:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120284160 00000100:00100000:3.0:1789061947.595573:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:3.0:1789061947.595585:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+39:11190:x1875967120284160:12345-192.168.203.3@tcp:36:dd.0 00010000:00010000:3.0:1789061947.596002:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6c0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.596025:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6c0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.596059:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6c0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061947.596440:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1789061947.596469:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001b558f3 reply state 00000000d8036848 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6c0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.596485:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6c0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061947.596493:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061947.596496:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789061947.596501:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061947.596655:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+42:11190:x1875967120284160:12345-192.168.203.3@tcp:36:dd.0 Request processed in 1069us (2621us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789061947.596663:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000020:00080000:3.0:1789061947.596670:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789061947.998314:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061947.998600:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120284288 00000100:00100000:2.0:1789061947.998664:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120284288 00000100:00100000:2.0:1789061947.998759:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1789061947.998770:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+42:11205:x1875967120284288:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:2.0:1789061947.998816:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061947.998843:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.998927:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c1a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.998944:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.998960:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.998972:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.998980:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.998987:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.999078:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6c28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.999113:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8a4 expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.999123:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6c28 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.999165:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8a4 expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061947.999440:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8a4 expref: 43 pid: 6498 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061947.999457:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c624aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1875967130859392:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061947.999815:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061948.010132:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061948.011501:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c624aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1875967130859392:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061948.011547:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6c28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061948.011857:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120284544 00000100:00100000:3.0:1789061948.011867:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120284544 00000100:00100000:3.0:1789061948.012003:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:3.0:1789061948.012015:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+44:6161:x1875967120284544:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789061948.012422:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+45:6161:x1875967120284544:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 408us (2303us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789061948.012431:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00080000:1.0:1789061948.017377:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061948.019934:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061948.021276:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120284672 00000100:00100000:1.0:1789061948.021293:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120284672 00010000:00010000:1.0:1789061948.021505:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8a4 expref: 45 pid: 6498 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061948.021640:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:1.0:1789061948.021653:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+45:2392:x1875967120284672:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061948.021675:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061948.021696:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8a4 expref: 45 pid: 6498 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.021713:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8a4 expref: 45 pid: 6498 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.021743:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6bf0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8a4 expref: 45 pid: 6498 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.021768:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061948.021774:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6c28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.021786:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6c28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.021826:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6c28 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.021872:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061948.022005:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+44:2392:x1875967120284672:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 354us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061948.022013:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00010000:00010000:2.0:1789061948.022084:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6c28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022094:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6c28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061948.022165:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789061948.022181:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061948.022241:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6c28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022271:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6c28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022282:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022289:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c1a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022297:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022303:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061948.022308:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022317:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022327:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:2.0:1789061948.022331:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061948.022336:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022342:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022356:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022362:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022375:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022380:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cec00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061948.022383:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022390:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022399:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9766c15bea00) 00010000:00010000:2.0:1789061948.022402:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061948.022405:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022411:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022473:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8b2 expref: 44 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022490:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6c28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8b2 expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.022498:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061948.022500:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061948.022503:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cfa00, rc 0) 00000100:00100000:2.0:1789061948.022540:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+43:11205:x1875967120284288:12345-192.168.203.3@tcp:101:stat.0 Request processed in 23772us (24254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061948.022556:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:3.0:1789061948.074075:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061948.074108:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130859520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061948.074537:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789061948.074550:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130859648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061948.074594:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061948.074835:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061948.075508:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130859520 00000100:00100000:0.0:1789061948.075519:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130859520 00000100:00100000:0.0:1789061948.075588:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789061948.075599:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130859520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789061948.075664:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789061948.075778:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061948.075801:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130859776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061948.075859:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061948.075906:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130859648 00000100:00100000:3.0:1789061948.075911:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130859648 00000100:00100000:3.0:1789061948.075943:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130859776 00000100:00100000:3.0:1789061948.075946:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130859776 00000100:00100000:3.0:1789061948.075959:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789061948.075966:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130859648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061948.075988:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061948.076030:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130859648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061948.076038:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789061948.076055:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789061948.076061:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130859776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789061948.076070:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061948.076096:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130859776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061948.076103:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789061948.076144:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130859776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061948.076180:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130859648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061948.082236:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130859520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6615us (8000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061948.082257:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789061948.091694:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130859520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061948.109094:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061948.109279:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120284928 00000100:00100000:2.0:1789061948.111663:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120284928 00000100:00100000:2.0:1789061948.111874:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1789061948.111887:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+43:11211:x1875967120284928:12345-192.168.203.3@tcp:36:truncate.0 00010000:00010000:2.0:1789061948.111968:0:10077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061948.112005:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6c28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8b2 expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.112033:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061948.112040:0:10077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061948.112279:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c2f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.112575:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.112591:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789061948.112718:0:10077:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1789061948.112745:0:10077:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a4c7371 reply state 000000002b342cdd transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.112759:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.112767:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061948.112770:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789061948.112803:0:10077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061948.113035:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+45:11211:x1875967120284928:12345-192.168.203.3@tcp:36:truncate.0 Request processed in 1148us (3953us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789061948.113045:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000020:00080000:2.0:1789061948.113052:0:10077:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789061948.204653:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789061948.268409:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789061948.270494:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789061948.351212:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061948.351491:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120285056 00000100:00100000:3.0:1789061948.351505:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120285056 00000100:00100000:3.0:1789061948.351602:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:3.0:1789061948.351657:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+45:11225:x1875967120285056:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:3.0:1789061948.351700:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061948.351732:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8b9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.351827:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c3d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.351844:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.351858:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.351870:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.351878:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.351885:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.351981:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.351992:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.351998:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061948.352061:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789061948.352067:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789061948.352094:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352111:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352120:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352126:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c3d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352133:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352139:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807be00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061948.352144:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352153:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c3d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352177:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:3.0:1789061948.352180:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061948.352187:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352193:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352221:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352227:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352233:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352239:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807ac00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061948.352242:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352248:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352256:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9766c15bea00) 00010000:00010000:3.0:1789061948.352258:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061948.352261:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352266:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352688:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8b9 expref: 47 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352706:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8b9 expref: 46 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.352727:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061948.352729:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061948.352732:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807ae00, rc 0) 00000100:00100000:3.0:1789061948.352835:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+46:11225:x1875967120285056:12345-192.168.203.3@tcp:101:stat.0 Request processed in 1178us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061948.352845:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:0.0:1789061948.456562:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061948.456886:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120285312 00000100:00100000:2.0:1789061948.456899:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120285312 00000100:00100000:2.0:1789061948.456975:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:2.0:1789061948.456988:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+46:11235:x1875967120285312:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061948.457015:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061948.457041:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8c0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061948.457185:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789061948.457325:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8c0 expref: 48 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.457343:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fd592800) 00010000:00010000:2.0:1789061948.457346:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061948.457352:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8c0 expref: 48 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.457372:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cec00, rc 0) 00000100:00100000:2.0:1789061948.457454:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+47:11235:x1875967120285312:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 468us (906us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1789061948.457462:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:2.0:1789061948.463259:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061948.463391:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120285568 00000100:00100000:3.0:1789061948.463406:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120285568 00000100:00100000:3.0:1789061948.463478:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1789061948.463491:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c624a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+47:11235:x1875967120285568:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1789061948.463850:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c624a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+48:11235:x1875967120285568:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 360us (604us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1789061948.463859:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:1.0:1789061948.513452:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061948.513640:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120285824 00000100:00100000:2.0:1789061948.513655:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120285824 00000100:00100000:2.0:1789061948.513742:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:2.0:1789061948.513754:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+48:11241:x1875967120285824:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1789061948.513786:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061948.513823:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c60 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8c7 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.513999:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.514018:0:10077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8b9 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.514029:0:10077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.514067:0:10077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8b9 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.514082:0:10077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8b9 expref: 49 pid: 6496 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061948.514098:0:10077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c6248700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130859904:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061948.514250:0:10077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0300 going to sleep for 11 seconds 00000100:00100000:0.0:1789061948.522269:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061948.522676:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120285952 00000100:00100000:3.0:1789061948.522685:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120285952 00010000:00010000:3.0:1789061948.522736:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8b9 expref: 50 pid: 6496 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061948.522780:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:3.0:1789061948.522800:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+50:2392:x1875967120285952:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061948.522815:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061948.522822:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8b9 expref: 50 pid: 6496 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.522835:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8b9 expref: 50 pid: 6496 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.522882:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061948.522888:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.522897:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.522904:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.522923:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061948.522979:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+50:2392:x1875967120285952:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 190us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061948.522986:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00010000:00010000:2.0:1789061948.525037:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc6c4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8b9 expref: 49 pid: 6496 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061948.525060:0:10077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c6248700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130859904:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061948.525098:0:10077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.525108:0:10077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.525114:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061948.525135:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789061948.525276:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6c60 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8c7 expref: 50 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.525294:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8c7 expref: 49 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061948.525302:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061948.525306:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789061948.525309:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce800, rc 0) 00000100:00100000:2.0:1789061948.525373:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+49:11241:x1875967120285824:12345-192.168.203.3@tcp:101:bash.0 Request processed in 11620us (11936us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789061948.525381:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:0.0:1789061948.534067:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061948.534156:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120286208 00000100:00100000:3.0:1789061948.534165:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120286208 00000100:00100000:3.0:1789061948.534232:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:3.0:1789061948.534243:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+49:11241:x1875967120286208:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:3.0:1789061948.534811:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.534828:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.534839:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061948.534886:0:8435:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1789061948.534910:0:8435:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdc164e7 reply state 0000000016797edd transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.534936:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.534943:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061948.534946:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789061948.534949:0:8435:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061948.535046:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+52:11241:x1875967120286208:12345-192.168.203.3@tcp:36:bash.0 Request processed in 803us (988us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789061948.535053:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00000020:00080000:3.0:1789061948.535058:0:8435:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789061948.547069:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061948.547391:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120286336 00000100:00100000:0.0:1789061948.547401:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120286336 00000100:00100000:0.0:1789061948.547462:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:0.0:1789061948.547472:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+52:11241:x1875967120286336:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1789061948.547495:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061948.547515:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6c7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8ce expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.547643:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6c83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.547660:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8c7 expref: 53 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.547669:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6c83 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.548080:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8c7 expref: 53 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.548163:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8c7 expref: 53 pid: 10077 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061948.548178:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130860032:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061948.548479:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789061948.551338:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130860032:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061948.551381:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6c83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061948.553602:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061948.553967:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120286464 00000100:00100000:3.0:1789061948.553979:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120286464 00010000:00010000:3.0:1789061948.554029:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8c7 expref: 54 pid: 10077 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061948.554078:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:3.0:1789061948.554089:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:2393:x1875967120286464:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061948.554109:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061948.554117:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8c7 expref: 54 pid: 10077 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.554131:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8c7 expref: 54 pid: 10077 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.554158:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc6c67 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8c7 expref: 54 pid: 10077 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.554213:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061948.554219:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6c83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.554231:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.554241:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6c83 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.554277:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061948.554342:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+53:2393:x1875967120286464:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 254us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061948.554350:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00010000:00010000:0.0:1789061948.554863:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.554874:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061948.554942:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789061948.554956:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789061948.554986:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.555024:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6c7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ce expref: 53 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.555043:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6c83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ce expref: 52 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.555051:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:0.0:1789061948.555055:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061948.555058:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613fe00, rc 0) 00000100:00100000:0.0:1789061948.555100:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+52:11241:x1875967120286336:12345-192.168.203.3@tcp:101:bash.0 Request processed in 7629us (8041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061948.555109:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:1.0:1789061948.561810:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061948.561946:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120286720 00000100:00100000:3.0:1789061948.561960:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120286720 00000100:00100000:3.0:1789061948.562034:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:3.0:1789061948.562045:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f07450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+52:11241:x1875967120286720:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:3.0:1789061948.562345:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f07450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+53:11241:x1875967120286720:12345-192.168.203.3@tcp:35:bash.0 Request processed in 300us (562us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789061948.562354:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1789061948.649118:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061948.649316:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120286976 00000100:00100000:1.0:1789061948.649329:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120286976 00000100:00100000:1.0:1789061948.649411:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:1.0:1789061948.649423:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c6248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+53:11251:x1875967120286976:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061948.649514:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061948.649540:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6c8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8d5 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061948.649936:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789061948.650070:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6c8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8d5 expref: 55 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.650087:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fd592800) 00010000:00010000:1.0:1789061948.650090:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789061948.650097:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6c8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8d5 expref: 55 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.650419:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a800, rc 0) 00000100:00100000:1.0:1789061948.650883:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c6248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:11251:x1875967120286976:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1461us (1780us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1789061948.650892:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:1.0:1789061948.655745:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061948.655881:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120287104 00000100:00100000:3.0:1789061948.655895:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120287104 00000100:00100000:3.0:1789061948.655976:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:3.0:1789061948.655988:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:11251:x1875967120287104:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:3.0:1789061948.656091:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c98 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656128:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656143:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656158:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656353:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656362:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656529:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6ca6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656541:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656549:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061948.656841:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656858:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656864:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c98 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656887:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656894:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807ac00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061948.656982:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.656993:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c98 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657007:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:3.0:1789061948.657011:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061948.657017:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657025:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6c98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657040:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657047:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657054:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657060:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807be00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061948.657063:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657080:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657088:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9766c15bea00) 00010000:00010000:3.0:1789061948.657091:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061948.657094:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657100:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6c9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657109:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657116:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6ca6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657122:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657128:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061948.657131:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657137:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657143:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061948.657146:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061948.657149:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6ca6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.657164:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6ca6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061948.657272:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:11251:x1875967120287104:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 1284us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061948.657281:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:0.0:1789061948.669109:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061948.669432:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120287360 00000100:00100000:3.0:1789061948.669446:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120287360 00000100:00100000:0.0:1789061948.670059:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:0.0:1789061948.670074:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:11251:x1875967120287360:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1789061948.670408:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+55:11251:x1875967120287360:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 336us (1311us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789061948.670417:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:2.0:1789061948.707377:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061948.707665:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120287616 00000100:00100000:0.0:1789061948.707679:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120287616 00000100:00100000:0.0:1789061948.707756:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:0.0:1789061948.707768:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c6249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+55:11254:x1875967120287616:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061948.707825:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061948.707873:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8dc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.707978:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6cb4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.707996:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708012:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708026:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708035:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708042:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708195:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6cc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708207:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708215:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061948.708227:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789061948.708340:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708360:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6cb4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708367:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708374:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613fa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061948.708379:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708387:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6cb4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708401:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061948.708404:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061948.708410:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6cb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708416:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6cb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708435:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708441:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cbb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708448:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708664:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613e800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061948.708674:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708681:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cbb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708690:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9766c15bea00) 00010000:00010000:0.0:1789061948.708692:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061948.708696:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cbb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708701:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cbb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708751:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8dc expref: 58 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708765:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8dc expref: 57 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.708772:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:0.0:1789061948.708774:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061948.708776:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613ec00, rc 0) 00000100:00100000:0.0:1789061948.708865:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c6249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+57:11254:x1875967120287616:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1098us (1511us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789061948.708873:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:1.0:1789061948.715692:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061948.715741:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061948.715804:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120287744 00000100:00100000:2.0:1789061948.715819:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120287744 00000100:00100000:3.0:1789061948.715892:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120287872 00000100:00100000:3.0:1789061948.715897:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120287872 00000100:00100000:2.0:1789061948.715900:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:2.0:1789061948.715915:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+58:11254:x1875967120287744:12345-192.168.203.3@tcp:54:lfs.0 00000100:00100000:3.0:1789061948.715964:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1789061948.715974:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+58:2390:x1875967120287872:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061948.715994:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061948.716028:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6cc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8dc expref: 58 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.716056:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061948.716062:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061948.716139:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+57:2390:x1875967120287872:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 167us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061948.716149:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00010000:00010000:3.0:1789061948.716276:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6cd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.716307:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.716328:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.716394:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.716403:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.716410:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.716417:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061948.716422:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.716430:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.716438:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061948.716441:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061948.716446:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6cd0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.716452:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6cd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061948.716506:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+56:11254:x1875967120287744:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 595us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061948.716513:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:1.0:1789061948.720557:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061948.721946:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120288128 00000100:00100000:2.0:1789061948.721962:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120288128 00000100:00100000:2.0:1789061948.722046:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1789061948.722215:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+56:11254:x1875967120288128:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1789061948.722558:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+57:11254:x1875967120288128:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 489us (2015us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789061948.722567:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1789061948.861279:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061948.863695:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120288384 00000100:00100000:3.0:1789061948.863717:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120288384 00000100:00100000:3.0:1789061948.863823:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:3.0:1789061948.863857:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c624b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+57:11272:x1875967120288384:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:3.0:1789061948.863891:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061948.863921:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6cd7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8e3 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.864091:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6cde lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.864111:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6cde lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.864125:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6cde lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061948.864149:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789061948.864298:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6cd7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8e3 expref: 60 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.864321:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6cde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8e3 expref: 59 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.864331:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061948.864334:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789061948.864339:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807be00, rc 0) 00000100:00100000:3.0:1789061948.864430:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c624b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:11272:x1875967120288384:12345-192.168.203.3@tcp:101:cat.0 Request processed in 576us (3165us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789061948.864438:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:1.0:1789061948.882823:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061948.883911:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120288512 00000100:00100000:0.0:1789061948.883928:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120288512 00000100:00100000:0.0:1789061948.884164:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:0.0:1789061948.884179:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:11273:x1875967120288512:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061948.884230:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061948.884258:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8ea expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.884348:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.884378:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.884392:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061948.884449:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789061948.884453:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789061948.884478:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.884521:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ea expref: 61 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.884548:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ea expref: 60 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.884557:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061948.884561:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061948.884566:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613e800, rc 0) 00000100:00100000:0.0:1789061948.884705:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:11273:x1875967120288512:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 529us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061948.884713:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:1.0:1789061948.895966:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061948.896082:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120288896 00000100:00100000:3.0:1789061948.896094:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120288896 00000100:00100000:3.0:1789061948.896248:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:3.0:1789061948.896261:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:11273:x1875967120288896:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1789061948.896695:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:11273:x1875967120288896:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 435us (742us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789061948.896704:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:2.0:1789061948.904720:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061948.904973:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120289024 00000100:00100000:3.0:1789061948.904987:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120289024 00000100:00100000:3.0:1789061948.905109:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1789061948.905121:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c624a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:11273:x1875967120289024:12345-192.168.203.3@tcp:103:lfs.0 00010000:00010000:3.0:1789061948.906247:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789061948.906294:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6c83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ce expref: 61 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.906324:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6cde lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8e3 expref: 60 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.906337:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6b80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b888 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061948.906347:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061948.906363:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061948.906453:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c624a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+58:11273:x1875967120289024:12345-192.168.203.3@tcp:103:lfs.0 Request processed in 1333us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061948.906462:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1789061948.911569:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061948.911703:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120289152 00000100:00100000:0.0:1789061948.911717:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120289152 00000100:00100000:0.0:1789061948.911804:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:0.0:1789061948.911816:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c624aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+58:11273:x1875967120289152:12345-192.168.203.3@tcp:58:lfs.0 00010000:00010000:0.0:1789061948.911976:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cfa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.912001:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061948.912014:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789061948.913327:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789061948.913744:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789061948.913854:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789061948.913986:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c624aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+58:11273:x1875967120289152:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 2165us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061948.913998:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:2.0:1789061948.941169:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061948.941287:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120289280 00000100:00100000:1.0:1789061948.941301:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120289280 00000100:00100000:1.0:1789061948.941386:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:1.0:1789061948.941399:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c6248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+58:11275:x1875967120289280:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061948.941427:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061948.941455:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6d01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8f1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941534:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d08 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941547:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941556:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941584:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6d0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941589:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6d0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941593:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6d0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941722:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941732:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941737:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061948.941801:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789061948.941807:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061948.941831:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941842:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941849:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941853:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d08 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941867:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941871:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061948.941875:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941880:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d08 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941891:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:1.0:1789061948.941893:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061948.941897:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941902:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941912:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6d0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941915:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6d0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941919:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6d0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941923:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ba00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061948.941924:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6d0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941934:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6d0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941939:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9766c15bea00) 00010000:00010000:1.0:1789061948.941940:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061948.941942:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6d0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941945:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6d0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941967:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6d01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8f1 expref: 60 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941977:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8f1 expref: 59 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061948.941981:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061948.941982:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789061948.941984:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a200, rc 0) 00000100:00100000:1.0:1789061948.942052:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c6248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:11275:x1875967120289280:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 657us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061948.942058:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 77 00010000:00010000:2.0:1789061949.228561:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789061949.291393:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061949.291405:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789061949.291464:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789061949.291473:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789061949.291704:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13772:1875967130860160:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789061949.291859:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061949.313135:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061949.313320:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13772:1875967130860160:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789061949.316297:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120289408 00000100:00100000:3.0:1789061949.316314:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120289408 00000100:00100000:3.0:1789061949.316528:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:3.0:1789061949.316548:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c624b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:11286:x1875967120289408:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789061949.316587:0:6497:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789061949.316751:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c624b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:11286:x1875967120289408:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 206us (3640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061949.316758:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:2.0:1789061949.328691:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061949.328804:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120289536 00000100:00100000:3.0:1789061949.328818:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120289536 00000100:00100000:3.0:1789061949.331880:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:3.0:1789061949.331908:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c624b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:11286:x1875967120289536:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789061949.332008:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d1d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332031:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332046:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332204:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6d24 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332228:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6d24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332252:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6d24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332288:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332316:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332324:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061949.332382:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789061949.332387:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789061949.332400:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332425:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332432:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d1d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332439:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332445:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061949.332449:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332456:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d1d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332468:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c7417500) 00010000:00010000:3.0:1789061949.332471:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061949.332475:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d1d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332492:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d1d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332509:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6d24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332515:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6d24 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332520:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6d24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332525:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061949.332528:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6d24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332534:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6d24 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332542:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9766c7415800) 00010000:00010000:3.0:1789061949.332544:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061949.332547:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6d24 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332552:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6d24 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332567:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332574:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332586:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332591:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807be00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061949.332595:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332601:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332655:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061949.332658:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061949.332661:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d2b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.332667:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061949.332763:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c624b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:11286:x1875967120289536:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 863us (4081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061949.332773:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:3.0:1789061949.343556:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000001:00080000:1.0:1789061949.343636:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000100:00100000:2.0:1789061949.343685:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120289792 00000004:00080000:1.0:1789061949.343698:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789061949.343699:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120289792 00000020:00080000:1.0:1789061949.343727:0:6474:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9766c65a0240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789061949.343733:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767fd48ba00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9766c65a0e40 00000020:00080000:1.0:1789061949.343736:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767fd48b100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9766c7600000 00000100:00100000:2.0:1789061949.343763:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:2.0:1789061949.343777:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+26:11286:x1875967120289792:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061949.343820:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc6abc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.343834:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc6abc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.343842:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc6abc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.343849:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061949.343855:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc6abc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.343863:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc6abc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.343882:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9766c7415900) 00010000:00010000:1.0:1789061949.343887:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061949.343893:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc6abc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.343900:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3799a00/0x2774d8f311dc6abc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061949.343922:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130860288:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789061949.343923:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc6ac3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.343935:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc6ac3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.343941:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc6ac3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.343958:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061949.343962:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc6ac3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.343968:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc6ac3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.343978:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:1.0:1789061949.343981:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061949.343985:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc6ac3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061949.343993:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789061949.343996:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc6ac3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.344014:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6b02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.344021:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6b02 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.344027:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6b02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.344033:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ac00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061949.344036:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6b02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.344043:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6b02 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.344063:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9766c15bea00) 00010000:00010000:1.0:1789061949.344066:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789061949.344069:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130860288 00010000:00010000:1.0:1789061949.344070:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6b02 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061949.344076:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130860288 00010000:00010000:1.0:1789061949.344082:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6b02 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.344104:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6c0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.344111:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6c0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.344117:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6c0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061949.344119:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789061949.344128:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061949.344133:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6c0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061949.344140:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875967130860288:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789061949.344142:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6c0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.344153:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061949.344157:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061949.344160:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6c0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.344166:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc6c0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789061949.344182:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1789061949.344218:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa2eb39, atime: 0x6aa2eb39, ctime: 0x6aa2eb39, blocks: 0x8 00010000:00010000:3.0:1789061949.344226:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc6d32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.344245:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1789061949.344249:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061949.344256:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc6d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.344277:0:8413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc6d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.344286:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc6d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.344295:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc6d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.344313:0:8413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789061949.344479:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3621:x1875967130860288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 342us (488us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789061949.344487:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789061949.344511:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789061949.344525:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061949.344532:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc6d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.344566:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789061949.344571:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc6d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.344580:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc6d32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.344594:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc6d32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.344603:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc6d32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.344641:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061949.344643:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061949.344645:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789061949.344680:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9766c77c2300/2, rc 0, transno 4294967302 00000100:00100000:3.0:1789061949.344687:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130860288:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789061949.346023:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346033:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346040:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346046:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061949.346050:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346058:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346072:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061949.346075:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061949.346080:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c2f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346086:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6c2f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346099:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346105:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346121:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346141:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061949.346145:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346151:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346161:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061949.346163:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061949.346167:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c75 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.346172:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc6c75 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789061949.348088:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789061949.348640:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1789061949.349289:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061949.349324:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6d39 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8f8 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.349463:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6d40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.349482:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.349514:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061949.349531:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789061949.350525:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.350541:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6d40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.350550:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6d40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.350558:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061949.350563:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6d40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.350573:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6d40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.350589:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061949.350592:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061949.350599:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6d40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.351533:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6d40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.352216:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6d39 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8f8 expref: 14 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.352260:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c7417500) 00010000:00010000:2.0:1789061949.352264:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061949.352270:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6d39 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8f8 expref: 14 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.352283:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cf800, rc 0) 00000100:00100000:2.0:1789061949.352382:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:11286:x1875967120289792:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 8607us (8836us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789061949.352392:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:2.0:1789061949.354590:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061949.357644:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120289920 00000100:00100000:3.0:1789061949.357663:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120289920 00000100:00100000:1.0:1789061949.358081:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:1.0:1789061949.358104:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:11286:x1875967120289920:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789061949.358146:0:8435:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789061949.358331:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:11286:x1875967120289920:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 229us (3751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061949.358339:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:3.0:1789061949.361964:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061949.362335:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120290176 00000100:00100000:0.0:1789061949.362348:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120290176 00000100:00100000:0.0:1789061949.362559:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:0.0:1789061949.362583:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:11286:x1875967120290176:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061949.362628:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061949.362632:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789061949.362669:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6cf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ea expref: 13 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.362694:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061949.362701:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061949.362718:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6d4e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b8ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789061949.363190:0:6497:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789061949.364730:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6d55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.364749:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.364761:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.364846:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6d4e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ff expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.364863:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6d55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ff expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.364872:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9767c28c7000) 00010000:00010000:0.0:1789061949.364875:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061949.364890:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613fa00, rc 0) 00000100:00100000:0.0:1789061949.364971:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:11286:x1875967120290176:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 2390us (3021us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789061949.364980:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:3.0:1789061949.374509:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061949.376500:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120290432 00000100:00100000:2.0:1789061949.376521:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120290432 00000100:00100000:2.0:1789061949.376645:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:2.0:1789061949.376657:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:11286:x1875967120290432:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789061949.376731:0:10077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061949.376765:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6d55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ff expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.376801:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9767c28c7000) 00010000:00010000:2.0:1789061949.376817:0:10077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061949.376893:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.376933:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.376947:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379670:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa9d1d3bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379695:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9d1d3bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379709:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9d1d3bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379796:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379804:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d63 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379811:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379818:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807be00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061949.379823:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379831:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379845:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:1.0:1789061949.379848:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061949.379853:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d63 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379860:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc6d63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379877:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9d1d3bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379883:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d6a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9d1d3bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379890:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9d1d3bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379904:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ac00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061949.379909:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d6a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9d1d3bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379916:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d6a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa9d1d3bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379925:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa9d1d3bb (ffff9766c15c0700) 00010000:00010000:1.0:1789061949.379928:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061949.379931:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d6a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa9d1d3bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.379938:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d6a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa9d1d3bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061949.380059:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:11286:x1875967120290432:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 3399us (5558us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789061949.380069:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:2.0:1789061949.384673:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061949.384755:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120290560 00000100:00100000:3.0:1789061949.384768:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120290560 00000100:00100000:3.0:1789061949.384855:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00100000:3.0:1789061949.384867:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:11286:x1875967120290560:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061949.384896:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061949.384925:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6d71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b906 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.384975:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.384992:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.385008:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.385154:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc6d71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b906 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.385180:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b906 expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.385204:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:3.0:1789061949.385208:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789061949.385212:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807a400, rc 0) 00000100:00100000:3.0:1789061949.385291:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:11286:x1875967120290560:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 425us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061949.385298:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00100000:3.0:1789061949.389058:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061949.389135:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120290816 00000100:00100000:1.0:1789061949.389150:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120290816 00000100:00100000:1.0:1789061949.390110:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 85 00000100:00100000:1.0:1789061949.390126:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:11286:x1875967120290816:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789061949.390215:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6d7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.390234:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6d7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.390247:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6d7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789061949.390421:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789061949.390431:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330499824191ns, next at 331499821907ns, rc = 0 00000004:00010000:1.0:1789061949.390475:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d129b39 reply state 00000000a1d29eef transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6d7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.390488:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6d7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.390496:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:1.0:1789061949.390501:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789061949.390505:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789061949.390646:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:11286:x1875967120290816:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 486us (1574us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789061949.390654:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 85 00000100:00100000:2.0:1789061949.399491:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061949.399569:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120290944 00000100:00100000:1.0:1789061949.399580:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120290944 00000100:00100000:1.0:1789061949.399939:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 86 00000100:00100000:1.0:1789061949.399950:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:11286:x1875967120290944:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061949.399974:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061949.399996:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b90d expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.400198:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b90d expref: 17 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.400214:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b90d expref: 17 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.400250:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:1.0:1789061949.400254:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061949.400258:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47ac00, rc 0) 00000100:00100000:1.0:1789061949.400308:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:11286:x1875967120290944:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 361us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061949.400314:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 86 00000100:00100000:3.0:1789061949.414740:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061949.414858:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120291072 00000100:00100000:0.0:1789061949.414871:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120291072 00000100:00100000:0.0:1789061949.414927:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:0.0:1789061949.414937:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1875967120291072:12345-192.168.203.3@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789061949.414981:0:8613:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:0.0:1789061949.415022:0:8613:0:(genops.c:1384:class_connect()) connect: client 8b387fcf-29cb-4ebc-866a-7eab61aa3868, cookie 0x2774d8f311dc6d8d 00002000:00100000:0.0:1789061949.415036:0:8613:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8b387fcf-29cb-4ebc-866a-7eab61aa3868/ffff9767c8f62800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789061949.415050:0:8613:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:0.0:1789061949.415140:0:8613:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789061949.415174:0:8613:0:(import.c:65:import_set_state_nolock()) ffff9767c8f64800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789061949.415323:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2389:x1875967120291072:12345-192.168.203.3@tcp:8:lhsmtool_posix.0 Request processed in 385us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061949.415332:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:3.0:1789061949.426151:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061949.426295:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120291200 00000100:00100000:0.0:1789061949.426308:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120291200 00000100:00100000:0.0:1789061949.426383:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:0.0:1789061949.426393:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:0:x1875967120291200:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789061949.426436:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789061949.430170:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:1.0:1789061949.430193:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000100:00100000:0.0:1789061949.436597:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:0:x1875967120291200:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 10191us (10447us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789061949.436630:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:2.0:1789061949.447871:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061949.448762:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120291456 00000100:00100000:0.0:1789061949.448818:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120291456 00000100:00100000:0.0:1789061949.448931:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:0.0:1789061949.448960:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:11286:x1875967120291456:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789061949.449711:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:11286:x1875967120291456:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 752us (1846us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789061949.449732:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:0.0:1789061949.457433:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061949.458723:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120291712 00000100:00100000:2.0:1789061949.458739:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120291712 00000100:00100000:2.0:1789061949.458831:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:2.0:1789061949.458844:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:11286:x1875967120291712:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789061949.458970:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:11286:x1875967120291712:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 129us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061949.458980:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:2.0:1789061949.470301:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061949.470435:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120291840 00000100:00100000:1.0:1789061949.470453:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120291840 00000100:00100000:1.0:1789061949.470545:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:1.0:1789061949.470557:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:11286:x1875967120291840:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061949.470585:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061949.470660:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6d94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b914 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.470756:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.470775:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.470803:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061949.470862:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061949.470902:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.470936:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6d94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b914 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.470957:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b914 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.470966:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:1.0:1789061949.470970:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789061949.470974:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b800, rc 0) 00000100:00100000:1.0:1789061949.471063:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:11286:x1875967120291840:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 506us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061949.471071:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:2.0:1789061949.475293:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061949.476228:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120291968 00000100:00100000:3.0:1789061949.476238:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120291968 00000100:00100000:3.0:1789061949.476302:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:3.0:1789061949.476313:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120291968:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061949.476332:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061949.476354:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc6da2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b91b expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061949.476380:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2eb3c, blocks: 0x0 00010000:00010000:3.0:1789061949.476399:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1789061949.476403:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061949.476412:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc6da2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b91b expref: 6 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.476431:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc6da2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b91b expref: 6 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.476460:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807b600, rc 0) 00000100:00100000:3.0:1789061949.476524:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120291968:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 213us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061949.476531:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:2.0:1789061949.485248:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061949.485711:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120292224 00000100:00100000:3.0:1789061949.485726:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120292224 00000100:00100000:3.0:1789061949.485816:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:3.0:1789061949.485831:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:11286:x1875967120292224:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789061949.485980:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:11286:x1875967120292224:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 153us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061949.485988:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:3.0:1789061949.500112:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061949.500220:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120292352 00000100:00100000:0.0:1789061949.500232:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120292352 00000100:00100000:0.0:1789061949.500335:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:0.0:1789061949.500347:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:11286:x1875967120292352:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061949.500380:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061949.500403:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b922 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.500446:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc6da2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b91b expref: 7 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.500457:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061949.500462:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061949.500468:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b922 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.500510:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc6da2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b91b expref: 7 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.500548:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc6da2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b91b expref: 7 pid: 8411 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061949.500566:0:8412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8412:1875967130860416:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061949.500735:0:8412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061949.506863:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061949.506911:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120292480 00000100:00100000:2.0:1789061949.506919:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120292480 00010000:00010000:2.0:1789061949.506968:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc6da2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b91b expref: 8 pid: 8411 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061949.507011:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:2.0:1789061949.507025:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120292480:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061949.507041:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061949.507063:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc6da2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b91b expref: 8 pid: 8411 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.507081:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc6da2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b91b expref: 8 pid: 8411 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.507108:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061949.507113:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061949.507123:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b922 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.507150:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b922 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.507197:0:9499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b922 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061949.507215:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7533b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9499:1875967130860544:192.168.203.3@tcp:105: 00000100:00100000:2.0:1789061949.507323:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1789061949.508824:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc6da2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b91b expref: 8 pid: 8411 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061949.508851:0:8412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8412:1875967130860416:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061949.508880:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b922 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.508894:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613e800, rc 0) 00000100:00100000:2.0:1789061949.508947:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:11286:x1875967120292352:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 8602us (8849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061949.508958:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:2.0:1789061949.521331:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061949.522176:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7533b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9499:1875967130860544:192.168.203.3@tcp:105: 00010000:00010000:3.0:1789061949.522219:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061949.522287:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120292480:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 15266us (15433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061949.522300:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:1.0:1789061949.525826:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120292608 00000100:00100000:1.0:1789061949.525848:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120292608 00002000:00100000:1.0:1789061949.525926:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9766c7530380 x1875967120292608/t0(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:370/0 lens 504/0 e 0 to 0 dl 1789061960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789061949.525938:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c7530380 with x1875967120292608 ext(0->8) 00002000:00010000:1.0:1789061949.525945:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c7530380 00000100:00100000:1.0:1789061949.526023:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:1.0:1789061949.526035:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120292608:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789061949.534374:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120292608:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 Request processed in 8330us (13047us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789061949.534389:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00002000:00100000:1.0:1789061949.534400:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9766c7530380 x1875967120292608/t4294967303(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:370/0 lens 504/448 e 0 to 0 dl 1789061960 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789061949.534422:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c7530380 with x1875967120292608 ext(0->8) 00002000:00010000:1.0:1789061949.534429:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c7530380 00000100:00100000:3.0:1789061949.542778:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061949.542916:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120292736 00000100:00100000:1.0:1789061949.542930:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120292736 00000100:00100000:1.0:1789061949.543007:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00100000:1.0:1789061949.543019:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:11286:x1875967120292736:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789061949.546540:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1789061949.546558:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789061949.546585:0:6474:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1789061949.546657:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789061949.546669:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789061949.546891:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:11286:x1875967120292736:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 3868us (4122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061949.546901:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 90 00010000:00010000:0.0:1789061949.548566:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6d7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.548587:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6d7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.548596:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6d7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.548603:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061949.548636:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6d7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.548645:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6d7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.548665:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:0.0:1789061949.548669:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789061949.548675:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6d7f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.548682:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6d7f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061949.548927:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130860672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789061949.549008:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061949.549978:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130860672 00000100:00100000:1.0:1789061949.549993:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130860672 00000100:00100000:3.0:1789061949.550057:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061949.550768:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120292864 00000100:00100000:1.0:1789061949.550774:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120292864 00000100:00100000:1.0:1789061949.550826:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789061949.550836:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130860672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789061949.550966:0:8411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789061949.550971:0:8411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789061948 00002000:00010000:1.0:1789061949.550974:0:8411:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789061949.550976:0:8411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789061948 -> 1789061948 00002000:00010000:1.0:1789061949.550978:0:8411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00080000:0.0:1789061949.550997:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789061949.551027:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:0.0:1789061949.551045:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120292864:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789061949.551069:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1875967130860672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 230us (2057us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789061949.551094:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1789061949.551325:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9766c7532680/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789061949.551335:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130860672:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1789061949.554937:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1789061949.554950:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1789061949.555159:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120292864:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 4109us (5095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061949.555175:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:3.0:1789061949.564224:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061949.564320:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120293120 00000100:00100000:0.0:1789061949.564338:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120293120 00000100:00100000:0.0:1789061949.564557:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:0.0:1789061949.564582:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:11286:x1875967120293120:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789061949.564914:0:10077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061949.564968:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6d9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b914 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.565007:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:0.0:1789061949.565014:0:10077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061949.565055:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6db0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.565073:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6db0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.565085:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6db0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061949.566745:0:10077:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ed5c163 reply state 0000000033dd75ac transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6db0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.566769:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6db0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.566791:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:0.0:1789061949.566795:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789061949.566799:0:10077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061949.566955:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:11286:x1875967120293120:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 2371us (2735us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789061949.566966:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:3.0:1789061949.577430:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061949.577659:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120293248 00000100:00100000:1.0:1789061949.577671:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120293248 00000100:00100000:1.0:1789061949.577725:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:1.0:1789061949.577734:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120293248:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789061949.577887:0:8411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789061949.577891:0:8411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789061948 -> 1789061947 00002000:00010000:1.0:1789061949.577894:0:8411:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789061945 00002000:00010000:1.0:1789061949.577896:0:8411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789061948 -> 1789061947 00002000:00010000:1.0:1789061949.577898:0:8411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789061949.577958:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2392:x1875967120293248:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 223us (537us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789061949.577965:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:3.0:1789061949.582258:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061949.582313:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120293504 00000100:00100000:1.0:1789061949.582323:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120293504 00000100:00100000:1.0:1789061949.582458:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00100000:1.0:1789061949.582469:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:11286:x1875967120293504:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789061949.582527:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.582544:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b906 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.582553:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.582594:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b906 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.582621:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b906 expref: 15 pid: 6498 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061949.582634:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130860800:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061949.582719:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1238300 going to sleep for 11 seconds 00000100:00100000:1.0:1789061949.590939:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130860800:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061949.591056:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061949.596387:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061949.596774:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120293632 00000100:00100000:1.0:1789061949.596795:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120293632 00010000:00010000:1.0:1789061949.596836:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b906 expref: 16 pid: 6498 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061949.596876:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:1.0:1789061949.596886:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:2393:x1875967120293632:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061949.596901:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061949.596907:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b906 expref: 16 pid: 6498 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.596920:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b906 expref: 16 pid: 6498 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.596960:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc6d78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b906 expref: 16 pid: 6498 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.596976:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:1.0:1789061949.596981:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.596990:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.596998:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.597035:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061949.597095:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:2393:x1875967120293632:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 210us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061949.597104:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00010000:00010000:0.0:1789061949.597326:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.597336:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.597374:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.597381:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.597389:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.597395:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061949.597400:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.597419:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.597430:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:0.0:1789061949.597433:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789061949.597437:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.597443:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6db7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061949.597503:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:11286:x1875967120293504:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 Request processed in 15033us (15250us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789061949.597512:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00100000:3.0:1789061949.604550:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061949.604812:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120293760 00000100:00100000:0.0:1789061949.604823:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120293760 00000100:00100000:0.0:1789061949.604883:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:0.0:1789061949.604893:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2391:x1875967120293760:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789061949.604935:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.604954:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b922 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.604964:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061949.604968:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789061949.604973:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.605014:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b922 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.605027:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b922 expref: 7 pid: 8412 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061949.605042:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1875967130860928:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061949.605391:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789061949.610466:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061949.610483:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1875967130860928:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061949.610517:0:8413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061949.610520:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120293888 00000100:00100000:1.0:1789061949.610536:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120293888 00010000:00010000:1.0:1789061949.610589:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b922 expref: 8 pid: 8412 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061949.610667:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:1.0:1789061949.610750:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120293888:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061949.610770:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061949.610803:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b922 expref: 8 pid: 8412 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.610831:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b922 expref: 8 pid: 8412 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.610862:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008968a072/0x2774d8f311dc6da9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b922 expref: 8 pid: 8412 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.610882:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061949.610888:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061949.610894:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.610906:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.610943:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061949.611019:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2392:x1875967120293888:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 341us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061949.611028:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00010000:00010000:0.0:1789061949.611947:0:8413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.611964:0:8413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.611996:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.612004:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.612013:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.612022:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613e000 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789061949.612043:0:8413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.612053:0:8413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.612075:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.612082:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004063b682/0x2774d8f311dc6dbe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061949.612175:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120293760:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 7280us (7632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061949.612185:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:3.0:1789061949.615277:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061949.618060:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120294144 00000100:00100000:0.0:1789061949.618075:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120294144 00000100:00100000:1.0:1789061949.618228:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 93 00000100:00100000:1.0:1789061949.618252:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:11286:x1875967120294144:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789061949.618364:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.618386:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6c05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ab expref: 14 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.618417:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.618475:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6c05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ab expref: 14 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.618492:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6c05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ab expref: 14 pid: 10077 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061949.618510:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130861056:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061949.618652:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1238300 going to sleep for 11 seconds 00000100:00100000:3.0:1789061949.622564:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061949.622635:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120294272 00000100:00100000:1.0:1789061949.622649:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120294272 00010000:00010000:1.0:1789061949.622707:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6c05 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ab expref: 15 pid: 10077 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061949.622754:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:1.0:1789061949.622767:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:2392:x1875967120294272:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061949.622793:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061949.622802:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6c05 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ab expref: 15 pid: 10077 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.622818:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6c05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ab expref: 15 pid: 10077 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.622844:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061949.622864:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.622877:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.622886:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.622907:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061949.622975:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:2392:x1875967120294272:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 211us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061949.622982:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00010000:00010000:2.0:1789061949.623142:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6c05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8ab expref: 14 pid: 10077 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061949.623170:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130861056:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061949.623195:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.623215:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.623222:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.623429:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.623442:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d86 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b90d expref: 14 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.623452:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.623483:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b90d expref: 14 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.623499:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b90d expref: 14 pid: 10077 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061949.623514:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7532d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130861184:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061949.623596:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061949.627012:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061949.627028:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7532d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130861184:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061949.627092:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061949.627376:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120294400 00000100:00100000:0.0:1789061949.627386:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120294400 00010000:00010000:0.0:1789061949.627429:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b90d expref: 15 pid: 10077 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061949.627470:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:0.0:1789061949.627479:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:2393:x1875967120294400:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061949.627492:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061949.627498:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b90d expref: 15 pid: 10077 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.627527:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b90d expref: 15 pid: 10077 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.627548:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6d86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b90d expref: 15 pid: 10077 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.627562:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:0.0:1789061949.627567:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.627576:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.627585:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061949.627630:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061949.627668:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.627680:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061949.627701:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:2393:x1875967120294400:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 221us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061949.627710:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000001:00080000:2.0:1789061949.627837:0:8435:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1789061949.627988:0:8435:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1789061949.628030:0:8435:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1789061949.628134:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7532d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8435:1875967130861312:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789061949.629374:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061949.629456:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130861312 00000100:00100000:3.0:1789061949.629467:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130861312 00000100:00100000:3.0:1789061949.629524:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789061949.629533:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8435:x1875967130861312:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789061949.629694:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8435:x1875967130861312:12345-0@lo:1000:mdt00_003.0 Request processed in 162us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061949.629702:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789061949.630022:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7480 going to sleep for 11 seconds 00000100:00100000:0.0:1789061949.630053:0:8435:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789061949.630059:0:8435:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9766c7532680, transno 4294967304 00000100:00100000:0.0:1789061949.630078:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7532d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8435:1875967130861312:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789061949.630244:0:8435:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1789061949.630325:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8435:1875967130861440:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789061949.630365:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061949.630406:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061949.631370:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130861440 00000100:00100000:1.0:1789061949.631384:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130861440 00000100:00100000:1.0:1789061949.631467:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789061949.631479:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8435:x1875967130861440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789061949.631761:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8435:x1875967130861440:12345-0@lo:1000:mdt00_003.0 Request processed in 284us (1394us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789061949.631772:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789061949.631836:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8435:1875967130861440:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789061949.631885:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.631895:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.631903:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.631909:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061949.631913:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.631921:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.631948:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:3.0:1789061949.631951:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061949.631957:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.631964:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6dcc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.632000:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.632008:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cfa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.632014:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cfa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.632019:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613f400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061949.632022:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cfa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.632028:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cfa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.632036:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061949.632039:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061949.632041:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cfa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.632047:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6cfa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.632111:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.632125:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8f1 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.632134:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.632240:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8f1 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.632256:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8f1 expref: 17 pid: 6498 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061949.632270:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0af480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130861568:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061949.632640:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061949.636686:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061949.636795:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120294528 00000100:00100000:1.0:1789061949.636809:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120294528 00010000:00010000:1.0:1789061949.636860:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8f1 expref: 18 pid: 6498 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061949.636915:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:1.0:1789061949.636928:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:2393:x1875967120294528:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061949.636949:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061949.636960:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8f1 expref: 18 pid: 6498 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061949.636986:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0af480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130861568:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061949.637006:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8f1 expref: 18 pid: 6498 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637021:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.637039:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6d16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b8f1 expref: 18 pid: 6498 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.637063:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061949.637069:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.637081:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.637090:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061949.637121:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061949.637194:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637205:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637218:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637242:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637249:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637255:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807aa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061949.637260:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637268:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637284:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061949.637287:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061949.637291:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637297:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dd3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637309:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637315:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061949.637325:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:2393:x1875967120294528:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 395us (648us total) trans 0 rc 0/0 00010000:00010000:3.0:1789061949.637327:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637346:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ba00 already unused, calling callback (ffffffffc1aff4f0) 00000100:00100000:1.0:1789061949.637350:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00010000:00010000:3.0:1789061949.637359:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637368:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637379:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061949.637382:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789061949.637386:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.637391:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc6dc5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061949.637585:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:11286:x1875967120294144:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 19342us (22315us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789061949.637595:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 93 00000020:00080000:3.0:1789061949.637601:0:8435:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789061949.638585:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061949.638593:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061949.638643:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789061949.638651:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061949.648550:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061949.648679:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120294784 00000100:00100000:3.0:1789061949.648693:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120294784 00000100:00100000:3.0:1789061949.649159:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:3.0:1789061949.649171:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:11286:x1875967120294784:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789061949.650659:0:6499:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789061949.650694:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1789061949.650740:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.650755:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.650766:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.650799:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dda lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.650807:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dda lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.650813:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.650836:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061949.651001:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061949.651015:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dda lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.651028:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807aa00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789061949.651032:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dda lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.651044:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.651063:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:2.0:1789061949.651067:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789061949.651073:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dda lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.651103:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc6dda lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.651123:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061949.651125:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061949.651127:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061949.651430:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:11286:x1875967120294784:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 2258us (2891us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789061949.651440:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000020:00080000:3.0:1789061949.651445:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1789061949.836844:0:14183:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061949.836852:0:14183:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789061949.836927:0:14183:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789061949.836936:0:14183:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061949.952024:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061949.952108:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120295040 00000100:00100000:3.0:1789061949.952118:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120295040 00000100:00100000:3.0:1789061949.952805:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 94 00000100:00100000:3.0:1789061949.952816:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:11296:x1875967120295040:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789061949.952838:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061949.952857:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6de1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b929 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.952964:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6de8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.952978:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6de8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.952991:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6de8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061949.953011:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789061949.953102:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6de1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b929 expref: 21 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.953118:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6de8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b929 expref: 20 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061949.953126:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:3.0:1789061949.953129:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789061949.953132:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807ac00, rc 0) 00000100:00100000:3.0:1789061949.953932:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:11296:x1875967120295040:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1116us (1915us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789061949.953941:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 94 00000100:00100000:2.0:1789061949.972558:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061949.972596:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120295168 00000100:00100000:2.0:1789061949.972633:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120295168 00000100:00100000:2.0:1789061949.972690:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:2.0:1789061949.972701:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:11296:x1875967120295168:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:2.0:1789061949.972772:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6df6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.972800:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6df6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.972812:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6df6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.972827:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6dfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.972834:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6dfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.972840:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6dfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.972921:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6e04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.972931:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6e04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.972939:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6e04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061949.972981:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6e04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.972994:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6df6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973001:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6df6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973008:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6df6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973014:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061949.973018:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6df6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973024:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6df6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973036:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:2.0:1789061949.973038:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061949.973043:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6df6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973055:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6df6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973068:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6dfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973074:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6dfd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973080:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6dfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973084:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061949.973087:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6dfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973093:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6dfd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973101:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9767fd592600) 00010000:00010000:2.0:1789061949.973103:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061949.973106:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6dfd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973111:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6dfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973124:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6e04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973131:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6e04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973143:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6e04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973148:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061949.973151:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6e04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973157:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6e04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973164:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767fd592c00) 00010000:00010000:2.0:1789061949.973166:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061949.973169:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6e04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061949.973174:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6e04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061949.973243:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:11296:x1875967120295168:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 543us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061949.973250:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:3.0:1789061950.039517:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061950.039833:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120295424 00000100:00100000:0.0:1789061950.039843:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120295424 00000100:00100000:0.0:1789061950.039922:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00100000:0.0:1789061950.039931:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:11299:x1875967120295424:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061950.039951:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061950.039972:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6e0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b930 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040041:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6e12 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040056:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6e12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040068:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6e12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040083:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040090:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040097:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040211:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040232:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040239:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061950.040259:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789061950.040335:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6e12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040343:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6e12 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040350:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6e12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040356:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613e800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061950.040361:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6e12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040369:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6e12 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040380:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061950.040383:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061950.040387:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6e12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040393:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6e12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040406:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040419:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040425:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040430:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613fe00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061950.040433:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040440:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040447:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9767c28c7300) 00010000:00010000:0.0:1789061950.040450:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061950.040453:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e19 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040459:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040500:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6e0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b930 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040512:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b930 expref: 22 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.040520:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:0.0:1789061950.040522:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061950.040530:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613f200, rc 0) 00000100:00100000:0.0:1789061950.040588:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:11299:x1875967120295424:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 657us (1079us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789061950.040595:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00080000:1.0:1789061950.041071:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061950.047597:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061950.047718:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120295552 00000100:00100000:3.0:1789061950.047728:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120295552 00000100:00100000:3.0:1789061950.047798:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 97 00000100:00100000:3.0:1789061950.047809:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:11299:x1875967120295552:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:3.0:1789061950.047874:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6e2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.047893:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6e2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.047905:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6e2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.047938:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6e2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.047959:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6e2e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.047966:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6e2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.047972:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061950.047977:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6e2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.047985:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6e2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.047996:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:3.0:1789061950.047999:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061950.048004:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6e2e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.048009:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6e2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061950.048076:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:11299:x1875967120295552:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 268us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061950.048083:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 97 00000100:00100000:0.0:1789061950.050462:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061950.050831:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120295808 00000100:00100000:2.0:1789061950.050840:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120295808 00000100:00100000:2.0:1789061950.050896:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1789061950.050906:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f05c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:11299:x1875967120295808:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1789061950.051253:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f05c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:11299:x1875967120295808:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 339us (788us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789061950.051276:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:0.0:1789061950.132666:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061950.132749:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120296064 00000100:00100000:1.0:1789061950.132758:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120296064 00000100:00100000:1.0:1789061950.132827:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 98 00000100:00100000:1.0:1789061950.132851:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:10825:x1875967120296064:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1789061950.132875:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061950.132895:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6e35 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b937 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.133000:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.133014:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b930 expref: 24 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.133023:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.133056:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b930 expref: 24 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.133069:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b930 expref: 24 pid: 8435 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061950.133084:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1875967130861696:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061950.133181:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1238a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789061950.139443:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1875967130861696:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061950.139447:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1789061950.139476:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061950.139539:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120296192 00000100:00100000:0.0:1789061950.139546:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120296192 00010000:00010000:0.0:1789061950.139581:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b930 expref: 25 pid: 8435 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061950.139653:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:0.0:1789061950.139664:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:2393:x1875967120296192:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061950.139679:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061950.139687:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b930 expref: 25 pid: 8435 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.139700:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b930 expref: 25 pid: 8435 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.139719:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b930 expref: 25 pid: 8435 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.139734:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:0.0:1789061950.139738:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.139748:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.139762:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.139788:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061950.139842:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:2393:x1875967120296192:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 180us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061950.139850:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00010000:00010000:1.0:1789061950.140067:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.140085:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061950.140102:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789061950.140220:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6e35 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b937 expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.140236:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b937 expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.140243:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:1.0:1789061950.140246:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789061950.140248:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47be00, rc 0) 00000100:00100000:1.0:1789061950.140401:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:10825:x1875967120296064:12345-192.168.203.3@tcp:101:bash.0 Request processed in 7552us (7744us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1789061950.140409:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 98 00000100:00100000:3.0:1789061950.150380:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061950.150475:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120296320 00000100:00100000:2.0:1789061950.150485:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120296320 00000100:00100000:2.0:1789061950.150547:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:2.0:1789061950.150558:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:10825:x1875967120296320:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1789061950.150583:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061950.150881:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6e4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b93e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.150920:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6e51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.150935:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6e51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.150946:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6e51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.151062:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc6e4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b93e expref: 26 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.151081:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6e51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b93e expref: 25 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.151090:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:2.0:1789061950.151093:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789061950.151097:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cf600, rc 0) 00000100:00100000:2.0:1789061950.153719:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:10825:x1875967120296320:12345-192.168.203.3@tcp:101:bash.0 Request processed in 3153us (3338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061950.153747:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:2.0:1789061950.160411:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061950.160496:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120296576 00000100:00100000:0.0:1789061950.160505:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120296576 00000100:00100000:0.0:1789061950.160571:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 100 00000100:00100000:0.0:1789061950.160581:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:10825:x1875967120296576:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:0.0:1789061950.160964:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.160981:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.160992:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061950.161032:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1789061950.161052:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa65bad4 reply state 00000000981c721e transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.161064:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.161072:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:0.0:1789061950.161075:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789061950.161092:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789061950.161132:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1789061950.161369:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:10825:x1875967120296576:12345-192.168.203.3@tcp:36:bash.0 Request processed in 787us (966us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789061950.161376:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 100 00000020:00080000:0.0:1789061950.161380:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789061950.167341:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061950.167431:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120296704 00000100:00100000:1.0:1789061950.167441:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120296704 00000100:00100000:1.0:1789061950.167495:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 101 00000100:00100000:1.0:1789061950.167504:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:10825:x1875967120296704:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1789061950.167524:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061950.167554:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6e5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b945 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.167648:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6e5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b945 expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.167683:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6e5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b945 expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.167703:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:1.0:1789061950.167706:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061950.167710:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a200, rc 0) 00000100:00100000:1.0:1789061950.167770:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:10825:x1875967120296704:12345-192.168.203.3@tcp:101:bash.0 Request processed in 266us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061950.167786:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 101 00000100:00100000:2.0:1789061950.171372:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061950.171647:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120296832 00000100:00100000:1.0:1789061950.171656:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120296832 00000100:00100000:1.0:1789061950.171717:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:1.0:1789061950.171727:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:10825:x1875967120296832:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1789061950.171744:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061950.171767:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc6e66 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b94c expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061950.171804:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa2eb3b, atime: 0x6aa2eb39, ctime: 0x6aa2eb3b, blocks: 0x8 00010000:00010000:1.0:1789061950.171824:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:1.0:1789061950.171829:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061950.171837:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc6e66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b94c expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.171855:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc6e66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b94c expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.171884:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47ba00, rc 0) 00000100:00100000:1.0:1789061950.171948:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:10825:x1875967120296832:12345-192.168.203.3@tcp:101:bash.0 Request processed in 222us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061950.171956:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:2.0:1789061950.174862:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061950.175834:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120296960 00000100:00100000:3.0:1789061950.175845:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120296960 00002000:00010000:3.0:1789061950.175894:0:8416:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789061950.175898:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c7530a80 with x1875967120296960 ext(0->18446744073709551615) 00002000:00010000:3.0:1789061950.175922:0:8416:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c7530a80. 00000100:00100000:3.0:1789061950.175965:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:3.0:1789061950.175980:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2392:x1875967120296960:12345-192.168.203.3@tcp:10:bash.0 00002000:00010000:3.0:1789061950.176317:0:8416:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789061950.176320:0:8416:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789061947 -> 1789061948 00002000:00010000:3.0:1789061950.176323:0:8416:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789061945 -> 1789061945 00002000:00010000:3.0:1789061950.176325:0:8416:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789061947 -> 1789061948 00002000:00010000:3.0:1789061950.176328:0:8416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1789061950.176439:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120296960:12345-192.168.203.3@tcp:10:bash.0 Request processed in 460us (1585us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789061950.176447:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00002000:00010000:3.0:1789061950.176450:0:8416:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789061950.176453:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c7530a80 with x1875967120296960 ext(0->18446744073709551615) 00002000:00010000:3.0:1789061950.176457:0:8416:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c7530a80. 00010000:00010000:2.0:1789061950.249858:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061950.272433:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061950.272524:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120297088 00000100:00100000:2.0:1789061950.272545:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120297088 00000100:00100000:2.0:1789061950.272641:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 102 00000100:00100000:2.0:1789061950.272653:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:11313:x1875967120297088:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:2.0:1789061950.272732:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6e6d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272750:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6e6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272761:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6e6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272786:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6e74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272795:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272802:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272869:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6e7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272897:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6e7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272905:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6e7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061950.272952:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6e7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272963:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6e6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272969:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6e6d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272975:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6e6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272981:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cee00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061950.272984:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6e6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.272992:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6e6d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273002:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:2.0:1789061950.273005:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061950.273010:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6e6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273017:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6e6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273039:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273045:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6e74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273050:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6e74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273056:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cfa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061950.273059:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6e74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273064:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6e74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273071:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9767fd592c00) 00010000:00010000:2.0:1789061950.273074:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061950.273077:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6e74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273082:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6e74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273097:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6e7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273102:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6e7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273108:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6e7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273119:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cec00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061950.273123:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6e7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273129:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6e7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273136:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:2.0:1789061950.273138:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061950.273141:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6e7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.273146:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6e7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061950.273225:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:11313:x1875967120297088:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 574us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061950.273232:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 102 00000100:00100000:2.0:1789061950.324853:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061950.325210:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120297344 00000100:00100000:0.0:1789061950.325220:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120297344 00000100:00100000:0.0:1789061950.325281:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:0.0:1789061950.325291:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:11316:x1875967120297344:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061950.325311:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061950.325332:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b953 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325413:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6e89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325427:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6e89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325438:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6e89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325451:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6e90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325457:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325463:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325578:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6e97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325587:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6e97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325594:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6e97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061950.325603:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789061950.325727:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6e89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325888:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6e89 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325905:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6e89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325911:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613f400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061950.325916:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6e89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325923:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6e89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325936:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061950.325939:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061950.325944:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6e89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325961:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6e89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325982:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325988:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6e90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325993:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6e90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.325997:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613fa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061950.326000:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6e90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.326006:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6e90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.326013:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9767c28c7300) 00010000:00010000:0.0:1789061950.326015:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061950.326018:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6e90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.326023:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6e90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.326061:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6e82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b953 expref: 33 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.326073:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6e97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b953 expref: 32 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.326084:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:0.0:1789061950.326086:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789061950.326088:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613e000, rc 0) 00000100:00100000:0.0:1789061950.326146:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:11316:x1875967120297344:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 857us (1303us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789061950.326152:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:0.0:1789061950.331368:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061950.331535:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120297472 00000100:00100000:3.0:1789061950.331545:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120297472 00000100:00100000:3.0:1789061950.331636:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00100000:3.0:1789061950.331648:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:11316:x1875967120297472:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:3.0:1789061950.331715:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.331732:0:10077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b937 expref: 32 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.331742:0:10077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.331804:0:10077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b937 expref: 32 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.331821:0:10077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b937 expref: 32 pid: 6498 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061950.331835:0:10077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130861824:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061950.331918:0:10077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d117f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789061950.334751:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061950.334820:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120297728 00000100:00100000:2.0:1789061950.334829:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120297728 00000100:00100000:2.0:1789061950.334885:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1789061950.334897:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+33:6162:x1875967120297728:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789061950.335267:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+34:6162:x1875967120297728:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 371us (524us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789061950.335274:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:0.0:1789061950.335368:0:10077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130861824:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061950.335401:0:10077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061950.338830:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061950.338908:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120297856 00000100:00100000:3.0:1789061950.338919:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120297856 00010000:00010000:3.0:1789061950.338969:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b937 expref: 34 pid: 6498 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061950.339009:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:3.0:1789061950.339019:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+34:2393:x1875967120297856:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061950.339035:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061950.339041:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b937 expref: 34 pid: 6498 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.339054:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b937 expref: 34 pid: 6498 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.339084:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6e3c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b937 expref: 34 pid: 6498 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.339130:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:3.0:1789061950.339135:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.339145:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.339153:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.339188:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061950.339238:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+33:2393:x1875967120297856:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 221us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061950.339246:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00010000:00010000:0.0:1789061950.339539:0:10077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.339549:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.339589:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.339596:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.339602:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.339639:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061950.339647:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.339664:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.339674:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:0.0:1789061950.339677:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789061950.339681:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.339686:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc6ea5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061950.339726:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:11316:x1875967120297472:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 8081us (8368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061950.339734:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00100000:1.0:1789061950.342360:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061950.343065:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120298112 00000100:00100000:2.0:1789061950.343084:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120298112 00000100:00100000:2.0:1789061950.343166:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1789061950.343177:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:11316:x1875967120298112:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1789061950.343433:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+33:11316:x1875967120298112:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 257us (1080us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789061950.343441:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:1.0:1789061950.454322:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061950.454413:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120298368 00000100:00100000:3.0:1789061950.454423:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120298368 00000100:00100000:3.0:1789061950.454476:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:3.0:1789061950.454485:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+33:11327:x1875967120298368:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:3.0:1789061950.454510:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061950.454530:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6eac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b95a expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.454648:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6eb3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.454663:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.454674:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.454696:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6eba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.454703:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6eba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.454710:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6eba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.454831:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc6ec1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.454841:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc6ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.454849:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc6ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061950.454858:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789061950.455761:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455773:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6eb3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455788:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455795:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807bc00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061950.455799:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455820:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6eb3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455833:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:3.0:1789061950.455836:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061950.455841:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6eb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455847:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6eb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455859:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6eba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455866:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6eba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455872:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6eba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455877:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061950.455880:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6eba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455886:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6eba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455902:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9766c7415200) 00010000:00010000:3.0:1789061950.455904:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061950.455907:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6eba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455922:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6eba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455968:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6eac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b95a expref: 36 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455981:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc6ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b95a expref: 35 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.455989:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:3.0:1789061950.455992:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061950.455995:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807b800, rc 0) 00000100:00100000:3.0:1789061950.456056:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+35:11327:x1875967120298368:12345-192.168.203.3@tcp:101:cat.0 Request processed in 1571us (1742us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789061950.456064:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:1.0:1789061950.463086:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061950.463179:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120298624 00000100:00100000:2.0:1789061950.463197:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120298624 00000100:00100000:2.0:1789061950.463254:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1789061950.463265:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+35:11327:x1875967120298624:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:2.0:1789061950.463525:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+36:11327:x1875967120298624:12345-192.168.203.3@tcp:35:cat.0 Request processed in 261us (447us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789061950.463533:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1789061950.489679:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061950.489831:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120298880 00000100:00100000:0.0:1789061950.489842:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120298880 00000100:00100000:0.0:1789061950.489912:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 106 00000100:00100000:0.0:1789061950.489922:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+36:11328:x1875967120298880:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:0.0:1789061950.489981:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789061950.490010:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc6e5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b945 expref: 36 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490030:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc6ec1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b95a expref: 35 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490042:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6e97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b953 expref: 34 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490088:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6e51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b93e expref: 33 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490099:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:0.0:1789061950.490104:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061950.490127:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6ecf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490140:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6ecf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490148:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6ecf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490163:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6ed6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490169:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490175:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490252:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6edd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490261:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6edd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490267:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6edd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789061950.490500:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789061950.490511:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331599903625ns, next at 332599901227ns, rc = 0 00010000:00010000:0.0:1789061950.490814:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6ee4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490824:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490832:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490839:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6ee4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490845:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6ee4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490850:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6ee4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490870:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789061950.490943:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6edd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490950:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6edd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490957:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6edd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490963:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613f400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061950.490978:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6edd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490986:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6edd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.490996:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:0.0:1789061950.490999:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789061950.491003:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6edd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.491009:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6edd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.491026:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6ecf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.491032:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6ecf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.491038:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6ecf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.491044:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613f200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061950.491047:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6ecf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.491053:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6ecf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.491060:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061950.491062:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061950.491082:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6ecf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.491089:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6ecf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061950.491099:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012d16289 reply state 000000005b39da1f transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.491110:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6ed6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.491117:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9767c28c7300) 00010000:00010000:0.0:1789061950.491119:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789061950.491122:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061950.491195:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+34:11328:x1875967120298880:12345-192.168.203.3@tcp:36:rm.0 Request processed in 1272us (1523us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789061950.491203:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 106 00010000:00010000:3.0:1789061950.491507:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061950.491514:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6ee4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.491521:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613e800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789061950.491524:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6ee4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.491531:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6ee4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.491540:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:3.0:1789061950.491543:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789061950.491553:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6ee4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.491558:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6ee4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.491569:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061950.491571:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061950.491572:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061950.537758:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061950.538076:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120299136 00000100:00100000:0.0:1789061950.538085:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120299136 00000100:00100000:0.0:1789061950.538182:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 107 00000100:00100000:0.0:1789061950.538192:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+34:11334:x1875967120299136:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1789061950.538216:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061950.538235:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6eeb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b961 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.538326:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6ef2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.538341:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.538371:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.538382:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6ef9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.538390:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.538397:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789061950.538709:0:10077:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789061950.538934:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6f00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.538943:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6f00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.538951:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6f00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.538981:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.538989:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6ef2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.538995:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6ef2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.539001:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613f400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061950.539011:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6ef2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.539020:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6ef2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.539033:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061950.539036:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061950.539041:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6ef2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.539048:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6ef2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061950.539061:0:10077:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8815b3b reply state 000000009d3fff4e transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.539072:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6ef9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.539078:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9767c28c7300) 00010000:00010000:0.0:1789061950.539080:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789061950.539083:0:10077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789061950.539113:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6eeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b961 expref: 37 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.539127:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6f00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b961 expref: 36 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.539134:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9767c28c7200) 00010000:00010000:0.0:1789061950.539136:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061950.539144:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613e800, rc 0) 00000100:00100000:0.0:1789061950.539343:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+37:11334:x1875967120299136:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1151us (1594us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789061950.539351:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 107 00000100:00100000:1.0:1789061950.545037:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061950.547206:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120299264 00000100:00100000:0.0:1789061950.547220:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120299264 00000100:00100000:0.0:1789061950.547358:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:0.0:1789061950.547370:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2391:x1875967120299264:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1789061950.547388:0:8613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061950.547408:0:8613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f0e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b968 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789061950.547436:0:8613:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789061950.547455:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1789061950.547459:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061950.547468:0:8613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b968 expref: 8 pid: 8613 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.547488:0:8613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b968 expref: 8 pid: 8613 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.547501:0:8613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613f200, rc 0) 00000100:00100000:0.0:1789061950.547566:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2391:x1875967120299264:12345-192.168.203.3@tcp:101:bash.0 Request processed in 199us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061950.547574:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00080000:1.0:1789061950.554203:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061950.559133:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061950.559507:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120299392 00000100:00100000:1.0:1789061950.559521:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120299392 00000100:00100000:1.0:1789061950.559705:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:1.0:1789061950.559719:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:11334:x1875967120299392:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1789061950.559746:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061950.559782:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b96f expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.560005:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f0e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b968 expref: 9 pid: 8613 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.560018:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061950.560023:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061950.560047:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.560090:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b968 expref: 9 pid: 8613 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.560107:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b968 expref: 9 pid: 8613 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061950.560125:0:8412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8412:1875967130861952:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061950.560267:0:8412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1238a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061950.564860:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061950.565240:0:8412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8412:1875967130861952:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061950.565287:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 9 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.565527:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a800, rc 0) 00000100:00100000:1.0:1789061950.565639:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:11334:x1875967120299392:12345-192.168.203.3@tcp:101:bash.0 Request processed in 5923us (6519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061950.565650:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:0.0:1789061950.567581:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120299520 00000100:00100000:0.0:1789061950.567599:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120299520 00010000:00010000:0.0:1789061950.567820:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b968 expref: 9 pid: 8613 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061950.567927:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:0.0:1789061950.567939:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2392:x1875967120299520:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061950.567959:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061950.567986:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b968 expref: 9 pid: 8613 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.568004:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b968 expref: 9 pid: 8613 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.568032:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f0e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b968 expref: 9 pid: 8613 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.568055:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061950.568060:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061950.568070:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.568081:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.568129:0:9499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061950.568170:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9499:1875967130862080:192.168.203.3@tcp:105: 00000100:00100000:0.0:1789061950.568287:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061950.573061:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061950.573241:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9499:1875967130862080:192.168.203.3@tcp:105: 00010000:00010000:0.0:1789061950.573274:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061950.573346:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120299520:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 5408us (8740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061950.573360:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:3.0:1789061950.574591:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120299776 00000100:00100000:3.0:1789061950.574627:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120299776 00000100:00100000:3.0:1789061950.574863:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1789061950.574877:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+37:11334:x1875967120299776:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:3.0:1789061950.575464:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:11334:x1875967120299776:12345-192.168.203.3@tcp:35:bash.0 Request processed in 590us (2416us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789061950.575473:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1789061950.634107:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061950.634141:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130862208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061950.634247:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061950.634489:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130862208 00000100:00100000:0.0:1789061950.634499:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130862208 00000100:00100000:0.0:1789061950.634580:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789061950.634592:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130862208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789061950.634694:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789061950.634753:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130862208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061950.634761:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789061950.635166:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130862208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789061950.746669:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061950.746956:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120299904 00000100:00100000:3.0:1789061950.746970:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120299904 00000100:00100000:3.0:1789061950.747046:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 108 00000100:00100000:3.0:1789061950.747058:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:11350:x1875967120299904:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789061950.747092:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061950.747120:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b976 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.747491:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6f23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.747509:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.747545:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061950.747600:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789061950.747630:0:8435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789061950.747654:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.747685:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b976 expref: 40 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.747708:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6f23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b976 expref: 39 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.747718:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:3.0:1789061950.747721:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789061950.747725:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807b000, rc 0) 00000100:00100000:3.0:1789061950.747813:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+39:11350:x1875967120299904:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 756us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061950.747822:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 108 00000100:00100000:0.0:1789061950.752728:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061950.753034:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120300160 00000100:00100000:2.0:1789061950.753047:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120300160 00000100:00100000:2.0:1789061950.753163:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 109 00000100:00100000:2.0:1789061950.753176:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+39:11350:x1875967120300160:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061950.753204:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061950.753249:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6f2a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b97d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.754535:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6f31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.754560:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6f31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.754576:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6f31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061950.754590:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789061950.754761:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc6f2a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b97d expref: 42 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.754795:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6f31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b97d expref: 41 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.754805:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9767c28c7200) 00010000:00010000:2.0:1789061950.754809:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061950.754813:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cec00, rc 0) 00000100:00100000:2.0:1789061950.754913:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+41:11350:x1875967120300160:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1739us (2198us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789061950.755228:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 109 00000100:00100000:2.0:1789061950.760310:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061950.762114:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120300288 00000100:00100000:3.0:1789061950.762134:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120300288 00000100:00100000:3.0:1789061950.762247:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:3.0:1789061950.762260:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+41:2392:x1875967120300288:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061950.762281:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061950.762316:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc6f31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b97d expref: 41 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.762543:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9767c28c7200) 00010000:00010000:3.0:1789061950.762549:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061950.768214:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061950.768347:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+40:2392:x1875967120300288:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 6070us (8033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061950.768363:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1789061950.768430:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120300544 00000100:00100000:0.0:1789061950.768443:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120300544 00000100:00100000:0.0:1789061950.768514:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 110 00000100:00100000:0.0:1789061950.768524:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+40:11350:x1875967120300544:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061950.768556:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061950.768585:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6f3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b984 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.768788:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6f46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.768807:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6f46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.768822:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6f46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061950.768838:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789061950.768988:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc6f3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b984 expref: 43 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.769010:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6f46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b984 expref: 42 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.769019:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9767c28c7200) 00010000:00010000:0.0:1789061950.769022:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789061950.769026:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613f400, rc 0) 00000100:00100000:0.0:1789061950.773629:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+42:11350:x1875967120300544:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 5075us (5399us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1789061950.773648:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 110 00000100:00100000:1.0:1789061950.782233:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061950.783839:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120300672 00000100:00100000:0.0:1789061950.783858:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120300672 00000100:00100000:0.0:1789061950.784072:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:0.0:1789061950.784086:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2390:x1875967120300672:12345-192.168.203.3@tcp:1:lfs.0 00010000:00010000:0.0:1789061950.784146:0:8613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.784200:0:8613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.784211:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061950.784217:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789061950.784222:0:8613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.784272:0:8613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.784288:0:8613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 8 pid: 8412 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061950.784305:0:8613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8613:1875967130862336:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061950.784456:0:8613:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061950.789837:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061950.790908:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120300800 00000100:00100000:1.0:1789061950.790925:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120300800 00002000:00100000:1.0:1789061950.791002:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9767c3065f80 x1875967120300800/t0(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:371/0 lens 504/0 e 0 to 0 dl 1789061961 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789061950.791014:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9767c3065f80 with x1875967120300800 ext(0->8) 00010000:00010000:1.0:1789061950.791026:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 9 pid: 8412 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.791064:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 9 pid: 8412 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061950.791074:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9767c3065f80 00000100:00100000:1.0:1789061950.791116:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:1.0:1789061950.791127:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2393:x1875967120300800:12345-192.168.203.3@tcp:4:lfs.0 00000100:00100000:0.0:1789061950.791151:0:8613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8613:1875967130862336:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061950.791182:0:8613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061950.794591:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:2393:x1875967120300800:12345-192.168.203.3@tcp:4:lfs.0 Request processed in 3450us (4754us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789061950.794928:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00002000:00100000:1.0:1789061950.794947:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9767c3065f80 x1875967120300800/t4294967303(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:371/0 lens 504/448 e 0 to 0 dl 1789061961 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789061950.794958:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9767c3065f80 with x1875967120300800 ext(0->8) 00010000:00010000:1.0:1789061950.794971:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 11 pid: 8412 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.794996:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 11 pid: 8412 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061950.795005:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9767c3065f80 00000100:00100000:1.0:1789061950.803295:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061950.803663:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120300928 00000100:00100000:2.0:1789061950.803791:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120300928 00010000:00010000:2.0:1789061950.803872:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 11 pid: 8412 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061950.803930:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:2.0:1789061950.803943:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:2390:x1875967120300928:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061950.803965:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789061950.804003:0:6482:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789061950.804006:0:6482:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789061949 00002000:00010000:2.0:1789061950.804008:0:6482:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789061949 00002000:00010000:2.0:1789061950.804011:0:6482:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789061949 00002000:00010000:2.0:1789061950.804013:0:6482:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789061950.804021:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 11 pid: 8412 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.804037:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 11 pid: 8412 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.804071:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc6f15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b96f expref: 11 pid: 8412 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.804094:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061950.804100:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061950.804112:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.804124:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.804183:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061950.804279:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:2390:x1875967120300928:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 338us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061950.804288:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00010000:00010000:1.0:1789061950.804504:0:8613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.804531:0:8613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.804569:0:8613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.804578:0:8613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.804588:0:8613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.804595:0:8613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613f200 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789061950.804601:0:8613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.804636:0:8613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.804653:0:8613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061950.804661:0:8613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eecc5565/0x2774d8f311dc6f54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061950.804732:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2390:x1875967120300672:12345-192.168.203.3@tcp:1:lfs.0 Request processed in 20650us (22514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061950.804741:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:0.0:1789061950.811353:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061950.811519:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120301184 00000100:00100000:3.0:1789061950.811532:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120301184 00000100:00100000:3.0:1789061950.811708:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:3.0:1789061950.811723:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f04450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+42:11350:x1875967120301184:12345-192.168.203.3@tcp:35:lfs.0 00000004:00010000:3.0:1789061950.811823:0:6499:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6f46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b984 expref: 42 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061950.812135:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1789061950.812171:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789061950.812654:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1789061950.812707:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.812725:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6f00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b961 expref: 46 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.812736:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.812792:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6f00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b961 expref: 46 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.812824:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6f00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b961 expref: 46 pid: 10077 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061950.812841:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe4b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1875967130862464:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061950.812957:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c81e2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789061950.818826:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe4b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1875967130862464:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061950.818868:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061950.825300:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061950.825346:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120301312 00000100:00100000:0.0:1789061950.825360:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120301312 00010000:00010000:0.0:1789061950.825415:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6f00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b961 expref: 47 pid: 10077 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061950.825462:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:0.0:1789061950.825474:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+47:2392:x1875967120301312:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061950.825491:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061950.825499:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6f00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b961 expref: 47 pid: 10077 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.825526:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6f00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b961 expref: 47 pid: 10077 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.825553:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc6f00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b961 expref: 47 pid: 10077 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.825574:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9767c28c7200) 00010000:00010000:0.0:1789061950.825580:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.825590:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.825600:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.825677:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061950.825739:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+46:2392:x1875967120301312:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 268us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061950.825748:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00010000:00010000:0.0:1789061950.825797:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061950.825810:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061950.825960:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1789061950.826096:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1789061950.826222:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1875967130862592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789061950.826282:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061950.826326:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0240 going to sleep for 11 seconds 00000100:00100000:2.0:1789061950.826564:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130862592 00000100:00100000:2.0:1789061950.826573:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130862592 00000100:00100000:2.0:1789061950.826639:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789061950.826649:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6499:x1875967130862592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789061950.826746:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6499:x1875967130862592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 99us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061950.826753:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789061950.826850:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1875967130862592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789061950.827001:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1789061950.827055:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f1df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1875967130862720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789061950.827089:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061950.827105:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061950.827156:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130862720 00000100:00100000:2.0:1789061950.827160:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130862720 00000100:00100000:2.0:1789061950.827192:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789061950.827200:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6499:x1875967130862720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789061950.827319:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6499:x1875967130862720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 119us (229us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789061950.827326:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789061950.830158:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f1df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1875967130862720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789061950.830287:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1789061950.830384:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.830397:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.830407:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.830415:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061950.830421:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.830430:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.830449:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9767c28c7200) 00010000:00010000:3.0:1789061950.830453:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789061950.830459:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.830492:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6f5b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789061950.830690:0:6499:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789061950.830785:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1789061950.830800:0:6499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331940193524ns, next at 332940190649ns, rc = 0 00000001:00080000:3.0:1789061950.830808:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1789061950.830837:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9767c28c7200) 00010000:00010000:3.0:1789061950.830840:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789061950.830849:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc6f46 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b984 expref: 50 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061950.831148:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f04450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+49:11350:x1875967120301184:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 19427us (19818us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789061950.831159:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000020:00080000:3.0:1789061950.831167:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789061950.834667:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061950.840049:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120301440 00000100:00100000:3.0:1789061950.840073:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120301440 00000100:00100000:3.0:1789061950.840168:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 111 00000100:00100000:3.0:1789061950.840181:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+49:11350:x1875967120301440:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789061950.840214:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061950.840246:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6f62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b98b expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.840325:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6f62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b98b expref: 50 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.840380:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6f62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b98b expref: 50 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061950.840403:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061950.840406:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061950.840410:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807bc00, rc 0) 00000100:00100000:3.0:1789061950.840498:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+50:11350:x1875967120301440:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 320us (5847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061950.840507:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 111 00000100:00100000:2.0:1789061950.847374:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061950.847976:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120301696 00000100:00100000:3.0:1789061950.847989:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120301696 00000100:00100000:3.0:1789061950.848065:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:3.0:1789061950.848077:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+50:11350:x1875967120301696:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1789061950.848401:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+51:11350:x1875967120301696:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 325us (1041us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789061950.848411:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1789061950.959955:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061950.966476:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120301824 00000100:00100000:2.0:1789061950.966500:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120301824 00000100:00100000:2.0:1789061950.967588:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 112 00000100:00100000:2.0:1789061950.967602:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+51:11360:x1875967120301824:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:2.0:1789061950.967843:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6f69 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.967889:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6f69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.967907:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6f69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.968060:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6f70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.968071:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6f70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.968079:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6f70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.968179:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6f77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.968188:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6f77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.968424:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6f77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061950.968497:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6f77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969031:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6f69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969041:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6f69 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969068:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6f69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969076:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061950.969080:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6f69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969089:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6f69 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969105:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:2.0:1789061950.969108:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061950.969114:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6f69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969120:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc6f69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969139:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6f70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969146:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6f70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969152:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6f70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969157:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061950.969161:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6f70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969178:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6f70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969187:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9767c28c7300) 00010000:00010000:2.0:1789061950.969189:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061950.969851:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6f70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969858:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc6f70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969873:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6f77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969880:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6f77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969886:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6f77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969891:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061950.969894:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6f77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969900:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6f77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969908:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061950.969911:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061950.969914:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6f77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061950.969941:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc6f77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061950.970062:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+51:11360:x1875967120301824:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 2456us (10116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061950.970072:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 112 00000100:00100000:2.0:1789061951.061439:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061951.061585:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120302080 00000100:00100000:0.0:1789061951.061600:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120302080 00000100:00100000:0.0:1789061951.061725:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 113 00000100:00100000:0.0:1789061951.061738:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+51:11363:x1875967120302080:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061951.061769:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061951.061807:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6f7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b992 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.061910:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6f85 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.061930:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6f85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.062830:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6f85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.062851:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6f8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.062862:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.062870:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063143:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc6f93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063154:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc6f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063162:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc6f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061951.063175:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789061951.063282:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6f85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063300:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6f85 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063309:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6f85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063316:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061951.063327:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6f85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063337:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6f85 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063476:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061951.063480:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061951.063487:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6f85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063495:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc6f85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063583:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063591:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6f8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063598:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6f8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063603:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061951.063798:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6f8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063806:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6f8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063816:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9767c28c7300) 00010000:00010000:0.0:1789061951.063819:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061951.063830:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6f8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063836:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc6f8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063895:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc6f7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b992 expref: 54 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063912:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc6f93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b992 expref: 53 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.063921:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:0.0:1789061951.063924:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061951.063926:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199a00, rc 0) 00000100:00100000:0.0:1789061951.064031:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+53:11363:x1875967120302080:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 2295us (2607us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789061951.064041:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 113 00000100:00100000:0.0:1789061951.070680:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.070797:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120302208 00000100:00100000:3.0:1789061951.070811:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120302208 00000100:00100000:3.0:1789061951.070891:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:3.0:1789061951.070904:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+53:11363:x1875967120302208:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:3.0:1789061951.071000:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6fa1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.071022:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.071126:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.071243:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.071250:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.071258:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.071263:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061951.071268:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.071275:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.071289:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061951.071291:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061951.071297:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6fa1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.071303:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc6fa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.071399:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+53:11363:x1875967120302208:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 496us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061951.071408:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 114 00000100:00100000:1.0:1789061951.080321:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.080454:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120302464 00000100:00100000:3.0:1789061951.080485:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120302464 00000100:00100000:3.0:1789061951.080561:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:3.0:1789061951.080573:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+53:11363:x1875967120302464:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1789061951.080918:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:11363:x1875967120302464:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 347us (613us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789061951.080927:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:2.0:1789061951.145935:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789061951.145968:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130862848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061951.146060:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061951.146322:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130862848 00000100:00100000:1.0:1789061951.146335:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130862848 00000100:00100000:1.0:1789061951.146422:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789061951.146435:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130862848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789061951.146464:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061951.146489:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061951.146503:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130862976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061951.146519:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130862848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061951.146529:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789061951.146549:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061951.146669:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130862848:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789061951.147325:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061951.153823:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130862976 00000100:00100000:1.0:1789061951.153846:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130862976 00000100:00100000:1.0:1789061951.153957:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789061951.153971:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3620:x1875967130862976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061951.154007:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061951.154115:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3620:x1875967130862976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (7568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061951.154123:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789061951.154198:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130862976:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789061951.154317:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061951.173067:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061951.173498:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120302720 00000100:00100000:0.0:1789061951.173512:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120302720 00000100:00100000:0.0:1789061951.173593:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:0.0:1789061951.173628:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:11373:x1875967120302720:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1789061951.173661:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061951.173664:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789061951.173701:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc6f23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b976 expref: 54 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.173749:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061951.173756:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061951.173783:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc6fa8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b999 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.173923:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.173940:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc6f93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b992 expref: 54 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.173950:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.173991:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc6f93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b992 expref: 54 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.174007:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc6f93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b992 expref: 54 pid: 10077 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061951.174024:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130863104:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061951.174173:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061951.183777:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.185893:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130863104:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061951.185931:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.195292:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120302848 00000100:00100000:3.0:1789061951.195312:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120302848 00010000:00010000:3.0:1789061951.195397:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc6f93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b992 expref: 55 pid: 10077 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.195442:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:3.0:1789061951.195453:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+55:2393:x1875967120302848:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061951.195483:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061951.195492:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc6f93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b992 expref: 55 pid: 10077 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.195507:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc6f93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b992 expref: 55 pid: 10077 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.195536:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc6f93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b992 expref: 55 pid: 10077 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.195559:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061951.195586:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.195601:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.195663:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.195709:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061951.195799:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:2393:x1875967120302848:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 346us (12044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061951.195806:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00010000:00010000:1.0:1789061951.196316:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.196335:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061951.196367:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789061951.196562:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc6fa8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b999 expref: 55 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.196581:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b999 expref: 54 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.196590:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061951.196593:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789061951.196596:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198000, rc 0) 00000100:00100000:1.0:1789061951.196680:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:11373:x1875967120302720:12345-192.168.203.3@tcp:101:bash.0 Request processed in 23077us (23639us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789061951.196689:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:0.0:1789061951.201359:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.201583:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120302976 00000100:00100000:3.0:1789061951.201596:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120302976 00000100:00100000:0.0:1789061951.201973:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:0.0:1789061951.201986:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:11373:x1875967120302976:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1789061951.202040:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061951.202069:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9a0 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.202113:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc6fc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.202132:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc6fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.202164:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc6fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.202311:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a0 expref: 56 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.202331:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc6fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a0 expref: 55 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.202341:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:0.0:1789061951.202345:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789061951.202349:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199e00, rc 0) 00000100:00100000:0.0:1789061951.202427:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+55:11373:x1875967120302976:12345-192.168.203.3@tcp:101:bash.0 Request processed in 443us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061951.202435:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:2.0:1789061951.210718:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061951.210917:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120303232 00000100:00100000:0.0:1789061951.210931:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120303232 00000100:00100000:0.0:1789061951.211002:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:0.0:1789061951.211015:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+55:11373:x1875967120303232:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:0.0:1789061951.211330:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fcb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.211452:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.211469:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061951.211668:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1789061951.212049:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a7f7b31 reply state 000000005f56d531 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.212069:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.212078:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:0.0:1789061951.212081:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789061951.212085:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061951.212471:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+58:11373:x1875967120303232:12345-192.168.203.3@tcp:36:bash.0 Request processed in 1455us (1773us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789061951.212481:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 117 00000020:00080000:0.0:1789061951.212486:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789061951.220945:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.221052:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120303360 00000100:00100000:1.0:1789061951.221074:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120303360 00000100:00100000:1.0:1789061951.221151:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:1.0:1789061951.221164:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+58:11373:x1875967120303360:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1789061951.221196:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061951.221225:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6fd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9a7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.221360:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.221402:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b999 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.221413:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.221460:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b999 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.221486:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b999 expref: 59 pid: 6496 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061951.221504:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130863232:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061951.221666:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789061951.225270:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.225445:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130863232:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061951.226390:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061951.226975:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120303488 00000100:00100000:0.0:1789061951.226987:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120303488 00010000:00010000:0.0:1789061951.227044:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b999 expref: 60 pid: 6496 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061951.228842:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:0.0:1789061951.228874:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:2392:x1875967120303488:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061951.228921:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061951.228934:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b999 expref: 60 pid: 6496 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.228954:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b999 expref: 60 pid: 6496 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.228982:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc6faf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b999 expref: 60 pid: 6496 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.229004:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:0.0:1789061951.229010:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.229022:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.229033:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.229167:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061951.229252:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:2392:x1875967120303488:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 393us (3996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061951.229261:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00010000:00010000:1.0:1789061951.231141:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.231161:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061951.231241:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789061951.231247:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061951.231278:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.231357:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc6fd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a7 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.231382:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a7 expref: 58 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.231391:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061951.233259:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061951.233268:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47be00, rc 0) 00000100:00100000:1.0:1789061951.233758:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+58:11373:x1875967120303360:12345-192.168.203.3@tcp:101:bash.0 Request processed in 12590us (12818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061951.233784:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:2.0:1789061951.239276:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.239375:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.242986:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.243018:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120303616 00000100:00100000:2.0:1789061951.243030:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120303616 00000100:00100000:2.0:1789061951.243108:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 376 00000100:00100000:2.0:1789061951.243120:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2393:x1875967120303616:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061951.243241:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2393:x1875967120303616:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 122us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061951.243249:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 376 00000100:00100000:2.0:1789061951.243318:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.243347:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120303872 00000100:00100000:2.0:1789061951.243350:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120303872 00000100:00100000:2.0:1789061951.243409:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:2.0:1789061951.243417:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120303872:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061951.243684:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120303872:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061951.243694:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00080000:2.0:1789061951.243916:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061951.243995:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061951.244338:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120303744 00000100:00100000:0.0:1789061951.244346:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120303744 00000100:00100000:0.0:1789061951.244412:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120304000 00000100:00100000:0.0:1789061951.244416:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120304000 00000100:00100000:0.0:1789061951.244444:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 269 00000100:00100000:0.0:1789061951.244453:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120303744:12345-192.168.203.3@tcp:400:kworker.0 00000100:00080000:3.0:1789061951.244579:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061951.244584:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789061951.244690:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120303744:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 238us (5429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061951.244698:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 269 00000100:00100000:0.0:1789061951.244717:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 270 00000100:00100000:0.0:1789061951.244724:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120304000:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061951.244750:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120304000:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (5375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061951.244756:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 270 00000100:00100000:2.0:1789061951.245648:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.245872:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120304128 00000100:00100000:1.0:1789061951.245882:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120304128 00000100:00100000:1.0:1789061951.246019:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 271 00000100:00100000:1.0:1789061951.246030:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120304128:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061951.246170:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2393:x1875967120304128:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 142us (2174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061951.246179:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 271 00000100:00100000:3.0:1789061951.246912:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120304384 00000100:00100000:3.0:1789061951.246922:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120304384 00000100:00100000:3.0:1789061951.246967:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:3.0:1789061951.246976:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+58:11373:x1875967120304384:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:3.0:1789061951.247384:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:11373:x1875967120304384:12345-192.168.203.3@tcp:35:bash.0 Request processed in 408us (1740us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1789061951.248331:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00080000:2.0:1789061951.248456:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789061951.273923:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061951.331271:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.331906:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120304512 00000100:00100000:2.0:1789061951.331922:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120304512 00000100:00100000:2.0:1789061951.332527:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:2.0:1789061951.332540:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:11379:x1875967120304512:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061951.332573:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061951.332601:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6fe0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9ae expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.333633:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6fe7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.333745:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.333763:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061951.333845:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789061951.333850:0:8435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061951.333877:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.333912:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc6fe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ae expref: 61 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.333937:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ae expref: 60 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.334010:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:2.0:1789061951.334073:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061951.334078:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cee00, rc 0) 00000100:00100000:2.0:1789061951.334450:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:11379:x1875967120304512:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1909us (3196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061951.334463:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:0.0:1789061951.338259:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.338731:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120304640 00000100:00100000:1.0:1789061951.338744:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120304640 00000100:00100000:1.0:1789061951.338825:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:1.0:1789061951.338837:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:11379:x1875967120304640:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061951.338863:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061951.338891:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6fee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9b5 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.339006:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6ff5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.339036:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.339052:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.339067:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6ffc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.339076:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.339083:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.339203:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7003 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.339214:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.339234:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061951.339292:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789061951.339297:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061951.339322:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.340943:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.340960:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.340968:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6ff5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.340977:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.340984:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061951.340989:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.340999:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6ff5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.341017:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:1.0:1789061951.341021:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061951.341027:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6ff5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.341033:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc6ff5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.341052:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.341059:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6ffc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.341085:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6ffc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.341091:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ac00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061951.341094:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6ffc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.341101:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6ffc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.341111:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9767c28c7300) 00010000:00010000:1.0:1789061951.341113:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061951.341116:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6ffc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.341122:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc6ffc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.341190:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc6fee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9b5 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.341209:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7003 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9b5 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.341218:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061951.341220:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061951.341223:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b800, rc 0) 00000100:00100000:1.0:1789061951.341315:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:11379:x1875967120304640:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 2479us (3071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061951.341335:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:1.0:1789061951.346975:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.347475:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120304768 00000100:00100000:3.0:1789061951.347488:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120304768 00000100:00100000:3.0:1789061951.347574:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:3.0:1789061951.347586:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:2393:x1875967120304768:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061951.347628:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061951.347699:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7003 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9b5 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.347722:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061951.347728:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061951.347899:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:2393:x1875967120304768:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 315us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061951.347907:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:1.0:1789061951.348462:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061951.348595:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120305024 00000100:00100000:0.0:1789061951.348632:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120305024 00000100:00100000:0.0:1789061951.348750:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:0.0:1789061951.348761:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:11379:x1875967120305024:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061951.348792:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061951.348888:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc700a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9bc expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.349277:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.349296:0:10077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a7 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.349307:0:10077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.349839:0:10077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a7 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.349876:0:10077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a7 expref: 61 pid: 6496 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061951.349895:0:10077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130863360:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061951.350248:0:10077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789061951.359008:0:10077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130863360:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061951.359058:0:10077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061951.359174:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.359506:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120305152 00000100:00100000:3.0:1789061951.359515:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120305152 00010000:00010000:3.0:1789061951.359561:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a7 expref: 62 pid: 6496 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.359668:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:3.0:1789061951.359679:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:2392:x1875967120305152:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061951.359700:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061951.359708:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a7 expref: 62 pid: 6496 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.359722:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a7 expref: 62 pid: 6496 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.359748:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc6fd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a7 expref: 62 pid: 6496 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.359766:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061951.359782:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.359812:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.359821:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.359860:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061951.359930:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:2392:x1875967120305152:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 252us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061951.359937:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00010000:00010000:1.0:1789061951.359995:0:10077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.360004:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061951.360038:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789061951.360228:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc700a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9bc expref: 62 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.360245:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9bc expref: 61 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.360254:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061951.360257:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789061951.360260:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198400, rc 0) 00000100:00100000:1.0:1789061951.360286:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:11379:x1875967120305024:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 11528us (11826us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789061951.360292:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:2.0:1789061951.364492:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061951.365094:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120305408 00000100:00100000:0.0:1789061951.365107:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120305408 00000100:00100000:0.0:1789061951.365856:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:0.0:1789061951.365889:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3066680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:11379:x1875967120305408:12345-192.168.203.3@tcp:103:lfs.0 00010000:00010000:0.0:1789061951.365910:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061951.365951:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc6f62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b98b expref: 61 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.365974:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:0.0:1789061951.365981:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061951.366055:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3066680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:11379:x1875967120305408:12345-192.168.203.3@tcp:103:lfs.0 Request processed in 189us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061951.366063:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:2.0:1789061951.370494:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.370649:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120305536 00000100:00100000:3.0:1789061951.370671:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120305536 00000100:00100000:3.0:1789061951.370742:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:3.0:1789061951.370753:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:11379:x1875967120305536:12345-192.168.203.3@tcp:58:lfs.0 00010000:00010000:3.0:1789061951.371480:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc701f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.371512:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc701f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.371529:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc701f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789061951.377462:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789061951.377801:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:11379:x1875967120305536:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 7039us (7314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061951.377837:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:1.0:1789061951.381876:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.381996:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120305664 00000100:00100000:3.0:1789061951.382010:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120305664 00000100:00100000:3.0:1789061951.382155:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:3.0:1789061951.382169:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c624a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:11379:x1875967120305664:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789061951.382197:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061951.382243:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc7026 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9c3 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.382318:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc701f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.382348:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc7026 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9c3 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.382381:0:6498:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc701f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.382396:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc7026 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9c3 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.382413:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061951.382416:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061951.382421:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc7026 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9c3 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.382429:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807bc00, rc 0) 00000100:00100000:3.0:1789061951.382502:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c624a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:11379:x1875967120305664:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 337us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061951.382509:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 123 00000040:00080000:1.0:1789061951.722694:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061951.722711:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061951.722756:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789061951.722778:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061951.722979:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7506300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13772:1875967130863488:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789061951.723120:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789061951.728902:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7506300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13772:1875967130863488:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789061951.730763:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061951.732698:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120305792 00000100:00100000:0.0:1789061951.732741:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120305792 00000100:00100000:0.0:1789061951.732846:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:0.0:1789061951.732858:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:11380:x1875967120305792:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789061951.732900:0:10077:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789061951.733813:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:11380:x1875967120305792:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 949us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061951.733826:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:1.0:1789061951.740730:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.740890:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120305920 00000100:00100000:2.0:1789061951.740902:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120305920 00000100:00100000:2.0:1789061951.740981:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:2.0:1789061951.740994:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:11380:x1875967120305920:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789061951.741092:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc702d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741114:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc702d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741129:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc702d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741155:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7034 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741327:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7034 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741336:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7034 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741368:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc703b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741378:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc703b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741385:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc703b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061951.741469:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789061951.741475:0:8435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061951.741493:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc703b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741506:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc702d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741725:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc702d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741734:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc702d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741742:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061951.741747:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc702d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741757:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc702d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741781:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c7417500) 00010000:00010000:2.0:1789061951.741784:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061951.741792:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc702d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741799:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc702d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741817:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7034 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741834:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7034 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741840:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7034 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741845:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cec00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061951.741848:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7034 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741856:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7034 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741864:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9767fd592c00) 00010000:00010000:2.0:1789061951.741868:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061951.741871:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7034 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741877:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7034 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741894:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc703b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741901:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc703b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741907:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc703b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741911:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cfa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061951.741921:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc703b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741928:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc703b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741936:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061951.741939:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061951.741942:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc703b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.741948:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc703b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061951.742054:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:11380:x1875967120305920:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 1060us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061951.742065:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:2.0:1789061951.750389:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.751262:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120306176 00000100:00100000:3.0:1789061951.751277:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120306176 00000100:00100000:3.0:1789061951.751437:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:3.0:1789061951.751450:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:11380:x1875967120306176:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061951.751477:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061951.751521:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7042 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9ca expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.752023:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7049 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.752163:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7049 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.752181:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7049 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061951.752198:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789061951.752313:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7049 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.752321:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7049 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.752329:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7049 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.752336:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061951.752342:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7049 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.752351:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7049 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.752365:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061951.752368:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789061951.752375:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7049 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.752395:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7049 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.752451:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7042 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ca expref: 63 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.752463:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c7417500) 00010000:00010000:3.0:1789061951.752466:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061951.752470:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7042 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ca expref: 63 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.752481:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807b000, rc 0) 00000100:00100000:3.0:1789061951.752573:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:11380:x1875967120306176:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1125us (2196us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1789061951.752583:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:1.0:1789061951.755870:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061951.755975:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120306304 00000100:00100000:0.0:1789061951.755988:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120306304 00000100:00100000:0.0:1789061951.756060:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:0.0:1789061951.756071:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:11380:x1875967120306304:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789061951.756118:0:10077:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789061951.756262:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:11380:x1875967120306304:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 193us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061951.756271:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:1.0:1789061951.771986:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.774036:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120306560 00000100:00100000:2.0:1789061951.774057:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120306560 00000100:00100000:2.0:1789061951.774208:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:2.0:1789061951.774222:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:11380:x1875967120306560:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061951.774251:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061951.774255:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789061951.774289:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc6fe7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ae expref: 62 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.774315:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:2.0:1789061951.774322:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061951.774357:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7057 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9d1 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789061951.774959:0:8435:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789061951.775147:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc705e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.775165:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc705e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.775178:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc705e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.775248:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7057 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9d1 expref: 64 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.775268:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc705e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9d1 expref: 63 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.775277:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592c00) 00010000:00010000:2.0:1789061951.775280:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061951.775283:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cec00, rc 0) 00000100:00100000:2.0:1789061951.775389:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+63:11380:x1875967120306560:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1169us (3418us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789061951.775398:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:1.0:1789061951.780262:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.780408:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120306816 00000100:00100000:3.0:1789061951.780422:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120306816 00000100:00100000:3.0:1789061951.780558:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:3.0:1789061951.780572:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+63:11380:x1875967120306816:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789061951.780681:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061951.780721:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc705e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9d1 expref: 63 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.780742:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592c00) 00010000:00010000:3.0:1789061951.780754:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061951.780793:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc706c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.780829:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc706c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.780842:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc706c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.780861:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7073 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xbdfb5429 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.780869:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbdfb5429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.780876:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbdfb5429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.780938:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc706c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.780946:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc706c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.780954:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc706c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.780961:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061951.780966:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc706c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.780974:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc706c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.780984:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:3.0:1789061951.780993:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061951.780998:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc706c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.781004:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc706c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.781014:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xbdfb5429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.781020:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7073 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbdfb5429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.781026:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7073 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbdfb5429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.781032:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061951.781035:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7073 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbdfb5429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.781041:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7073 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xbdfb5429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.781062:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xbdfb5429 (ffff9766c7415400) 00010000:00010000:3.0:1789061951.781065:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061951.781069:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7073 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xbdfb5429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.781075:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7073 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xbdfb5429 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.781181:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:11380:x1875967120306816:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 611us (935us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789061951.781196:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:0.0:1789061951.786917:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.787132:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120306944 00000100:00100000:2.0:1789061951.787145:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120306944 00000100:00100000:2.0:1789061951.787225:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:2.0:1789061951.787237:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:11380:x1875967120306944:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061951.787284:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061951.787316:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc707a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9d8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.787364:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7081 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.787380:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.787394:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.787530:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc707a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9d8 expref: 64 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.787554:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7081 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9d8 expref: 63 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.787563:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:2.0:1789061951.787566:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789061951.787571:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cee00, rc 0) 00000100:00100000:2.0:1789061951.787948:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+63:11380:x1875967120306944:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 712us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061951.787957:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:1.0:1789061951.792156:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.792244:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120307200 00000100:00100000:2.0:1789061951.792258:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120307200 00000100:00100000:2.0:1789061951.792336:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:2.0:1789061951.792348:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f38b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+63:11380:x1875967120307200:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789061951.792487:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7088 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.792511:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7088 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.792528:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7088 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789061951.792836:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1789061951.792850:0:8435:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332902243287ns, next at 333902239715ns, rc = 0 00000004:00010000:2.0:1789061951.792917:0:8435:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c732bb5 reply state 000000008959a027 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7088 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.792932:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7088 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.792941:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:2.0:1789061951.792944:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789061951.792949:0:8435:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061951.793071:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f38b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+65:11380:x1875967120307200:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 724us (934us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789061951.793079:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:1.0:1789061951.795727:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.795842:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120307328 00000100:00100000:3.0:1789061951.795854:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120307328 00000100:00100000:3.0:1789061951.795928:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:3.0:1789061951.795939:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c56fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+65:11380:x1875967120307328:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061951.795983:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061951.796011:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc708f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9df expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.796095:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc708f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9df expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.796112:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc708f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9df expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.796135:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:3.0:1789061951.796138:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061951.796150:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807b800, rc 0) 00000100:00100000:3.0:1789061951.796223:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c56fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+66:11380:x1875967120307328:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 280us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061951.796230:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:1.0:1789061951.802234:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.802522:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120307456 00000100:00100000:3.0:1789061951.802537:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120307456 00000100:00100000:3.0:1789061951.802643:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:3.0:1789061951.802657:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120307456:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789061951.803033:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2392:x1875967120307456:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 378us (814us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789061951.803063:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:0.0:1789061951.806509:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.806762:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120307712 00000100:00100000:1.0:1789061951.806784:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120307712 00000100:00100000:1.0:1789061951.806906:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:1.0:1789061951.806918:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+66:11380:x1875967120307712:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789061951.807274:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:11380:x1875967120307712:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 357us (780us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1789061951.807282:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:2.0:1789061951.809906:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061951.810350:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120307968 00000100:00100000:0.0:1789061951.810364:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120307968 00000100:00100000:0.0:1789061951.810546:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:0.0:1789061951.810559:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:11380:x1875967120307968:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789061951.810798:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:11380:x1875967120307968:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 241us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061951.810807:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:0.0:1789061951.814849:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.814952:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120308096 00000100:00100000:1.0:1789061951.814964:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120308096 00000100:00100000:1.0:1789061951.815076:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:1.0:1789061951.815088:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:11380:x1875967120308096:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061951.815115:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061951.815148:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7096 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9e6 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.815246:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc709d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.815281:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc709d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.815296:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc709d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061951.815353:0:10077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061951.815376:0:10077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc709d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.815419:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7096 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9e6 expref: 69 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.815442:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc709d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9e6 expref: 68 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.815451:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:1.0:1789061951.815454:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789061951.815458:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47be00, rc 0) 00000100:00100000:1.0:1789061951.815577:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:11380:x1875967120308096:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 491us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061951.815585:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:1.0:1789061951.819128:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.819289:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120308224 00000100:00100000:2.0:1789061951.819301:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120308224 00000100:00100000:2.0:1789061951.819445:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:2.0:1789061951.819459:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2392:x1875967120308224:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061951.819482:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061951.819526:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc70a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9ed expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789061951.819561:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2eb3e, blocks: 0x0 00010000:00010000:2.0:1789061951.819587:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1789061951.819593:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061951.819625:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc70a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ed expref: 10 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.819648:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc70a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ed expref: 10 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.819675:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce600, rc 0) 00000100:00100000:2.0:1789061951.819759:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:2392:x1875967120308224:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 303us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061951.819775:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:3.0:1789061951.822695:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061951.822921:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120308480 00000100:00100000:0.0:1789061951.822952:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120308480 00000100:00100000:0.0:1789061951.823024:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:0.0:1789061951.823034:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:11380:x1875967120308480:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789061951.823182:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:11380:x1875967120308480:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 148us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061951.823190:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:0.0:1789061951.825965:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.826437:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120308608 00000100:00100000:1.0:1789061951.826448:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120308608 00000100:00100000:0.0:1789061951.826571:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:0.0:1789061951.826583:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:11380:x1875967120308608:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061951.826625:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061951.826650:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9f4 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.826698:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc70a4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ed expref: 11 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.826708:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061951.826713:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061951.826719:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9f4 expref: 11 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.826758:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc70a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ed expref: 11 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.826784:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc70a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ed expref: 11 pid: 8411 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061951.826824:0:8412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8412:1875967130863616:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061951.826928:0:8412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061951.837208:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.838515:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120308736 00000100:00100000:2.0:1789061951.838532:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120308736 00010000:00010000:2.0:1789061951.838593:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc70a4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ed expref: 12 pid: 8411 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061951.838718:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:2.0:1789061951.838731:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+12:2393:x1875967120308736:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061951.838753:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061951.838794:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc70a4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ed expref: 12 pid: 8411 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.838838:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc70a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ed expref: 12 pid: 8411 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.838876:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061951.838881:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061951.838894:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9f4 expref: 12 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.838907:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9f4 expref: 12 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.838962:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9f4 expref: 12 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061951.838982:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7752680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6481:1875967130863744:192.168.203.3@tcp:105: 00000100:00100000:2.0:1789061951.839112:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767cdb18f00 going to sleep for 11 seconds 00010000:00010000:1.0:1789061951.840342:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc70a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9ed expref: 12 pid: 8411 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061951.840390:0:8412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8412:1875967130863616:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061951.840426:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9f4 expref: 11 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.840441:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199400, rc 0) 00000100:00100000:1.0:1789061951.840515:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:11380:x1875967120308608:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 13932us (14572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061951.840525:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:1.0:1789061951.841707:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7752680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6481:1875967130863744:192.168.203.3@tcp:105: 00010000:00010000:1.0:1789061951.841734:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061951.841795:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:2393:x1875967120308736:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3066us (4601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061951.841806:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:3.0:1789061951.847208:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.847363:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120308864 00000100:00100000:1.0:1789061951.847377:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120308864 00002000:00100000:1.0:1789061951.847460:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9767ffe4bb80 x1875967120308864/t0(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:372/0 lens 504/0 e 0 to 0 dl 1789061962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789061951.847473:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9767ffe4bb80 with x1875967120308864 ext(0->12) 00002000:00010000:1.0:1789061951.847480:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9767ffe4bb80 00000100:00100000:1.0:1789061951.847518:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:1.0:1789061951.847529:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:2392:x1875967120308864:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789061951.849159:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+12:2392:x1875967120308864:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 Request processed in 1621us (1956us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789061951.849172:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00002000:00100000:3.0:1789061951.849183:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9767ffe4bb80 x1875967120308864/t4294967309(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:372/0 lens 504/448 e 0 to 0 dl 1789061962 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789061951.849195:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9767ffe4bb80 with x1875967120308864 ext(0->12) 00002000:00010000:3.0:1789061951.849201:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9767ffe4bb80 00000100:00100000:2.0:1789061951.861163:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061951.862836:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120308992 00000100:00100000:0.0:1789061951.862853:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120308992 00000100:00100000:0.0:1789061951.862962:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:0.0:1789061951.862975:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:11380:x1875967120308992:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789061951.866316:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1789061951.866361:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:3.0:1789061951.866760:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130864000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789061951.866895:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061951.866953:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789061951.866960:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130863872:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789061951.866983:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061951.867018:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130864000 00000100:00100000:3.0:1789061951.867029:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130864000 00000100:00100000:3.0:1789061951.867244:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130863872 00000100:00100000:3.0:1789061951.867249:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130863872 00000100:00100000:3.0:1789061951.867276:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789061951.867286:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3623:x1875967130864000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789061951.867519:0:8613:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789061951.867523:0:8613:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789061950 00002000:00010000:3.0:1789061951.867526:0:8613:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789061951.867528:0:8613:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789061950 -> 1789061950 00002000:00010000:3.0:1789061951.867543:0:8613:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789061951.867592:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3623:x1875967130864000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 308us (698us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789061951.867601:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789061951.867647:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000004:00080000:1.0:1789061951.867847:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789061951.867868:0:6474:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9767d11ce180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789061951.867872:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767ffd79700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9767d1238a80 00000020:00080000:1.0:1789061951.867875:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767fd735100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9766c81b4000 00000004:00080000:1.0:1789061951.867901:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789061951.867935:0:6474:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9767fd5bbf00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789061951.867938:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767ffd70a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9767fd5bb3c0 00000020:00080000:1.0:1789061951.867942:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767ffd70500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9766c7198600 00010000:00010000:2.0:1789061951.868251:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6db0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868264:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6db0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868273:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6db0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868295:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613ec00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061951.868300:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6db0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868309:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6db0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868328:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9766c7415800) 00010000:00010000:2.0:1789061951.868331:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061951.868337:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6db0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868343:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc6db0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868374:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868381:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868387:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868405:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613fe00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061951.868408:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868413:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868434:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9767c28c7600) 00010000:00010000:2.0:1789061951.868437:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061951.868440:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e58 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868446:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc6e58 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868466:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6ed6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868472:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6ed6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868477:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6ed6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868482:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613fa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061951.868485:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6ed6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868490:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6ed6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868497:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9767c28c7300) 00010000:00010000:2.0:1789061951.868500:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061951.868502:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6ed6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868508:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc6ed6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868531:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6ef9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868537:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6ef9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868543:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6ef9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868549:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613e000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061951.868551:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6ef9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868557:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6ef9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868565:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9767c28c7300) 00010000:00010000:2.0:1789061951.868568:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061951.868571:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6ef9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868576:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc6ef9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868592:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868599:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fcb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.868644:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789061951.870980:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:2.0:1789061951.871778:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061951.871791:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.871807:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fcb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.871831:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061951.871834:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061951.871840:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fcb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.871848:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc6fcb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.871882:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7088 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.871889:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7088 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.871896:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7088 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.871901:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061951.871904:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7088 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.871910:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7088 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.871944:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:2.0:1789061951.871946:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789061951.871950:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7088 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.871956:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7088 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.872156:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3623:x1875967130863872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789061951.872206:0:8613:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1789061951.872236:0:8613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.872261:0:8613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc6e66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b94c expref: 11 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.872270:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789061951.872275:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061951.872280:0:8613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.872320:0:8613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc6e66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b94c expref: 11 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.872338:0:8613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc6e66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b94c expref: 11 pid: 8412 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.872355:0:8613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe49500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8613:1875967130864128:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061951.872463:0:8613:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c81e2a80 going to sleep for 11 seconds 00000020:00080000:1.0:1789061951.872797:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789061951.872816:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130864256:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1789061951.872816:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789061951.872875:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061951.872923:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:11380:x1875967120308992:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 9950us (11784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061951.872935:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:0.0:1789061951.872976:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130864256 00000100:00100000:0.0:1789061951.872986:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130864256 00000100:00100000:0.0:1789061951.873022:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789061951.873030:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3620:x1875967130864256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789061951.873045:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:0.0:1789061951.873077:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa2eb3d, atime: 0x6aa2eb3d, ctime: 0x6aa2eb3d, blocks: 0x8 00010000:00010000:0.0:1789061951.873083:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc70b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.873094:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1789061951.873097:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061951.873103:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc70b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.873135:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc70b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.873222:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc70b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.873231:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc70b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.873259:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789061951.873342:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9767ffe4a680/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789061951.873350:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130864000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789061951.873720:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3620:x1875967130864256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 689us (844us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789061951.873735:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1789061951.873778:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9767ffe49880/2, rc 0, transno 4294967305 00000100:00100000:0.0:1789061951.873784:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130864256:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789061951.874125:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061951.874133:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc70b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.874143:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199000 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789061951.874147:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc70b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.874158:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc70b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.874178:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc70b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.874198:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc70b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.874221:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061951.874223:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061951.874225:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789061951.877249:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1789061951.877273:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1789061951.884231:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.884337:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120309120 00000100:00100000:1.0:1789061951.884350:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120309120 00000100:00100000:1.0:1789061951.884431:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:1.0:1789061951.884446:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+12:2391:x1875967120309120:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789061951.884533:0:8613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe49500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8613:1875967130864128:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061951.884568:0:8613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061951.884844:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000001:00080000:1.0:1789061951.887487:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1789061951.887507:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1789061951.888059:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120309248 00000100:00100000:3.0:1789061951.888073:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120309248 00010000:00010000:3.0:1789061951.888133:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc6e66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b94c expref: 8 pid: 8412 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.888189:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:3.0:1789061951.888202:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120309248:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061951.888220:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061951.888226:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc6e66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b94c expref: 8 pid: 8412 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.888240:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc6e66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b94c expref: 8 pid: 8412 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.888268:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc6e66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b94c expref: 8 pid: 8412 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.888288:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061951.888294:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061951.888301:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.888342:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.888382:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061951.888454:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2393:x1875967120309248:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 254us (3610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061951.888462:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 74 00000100:00100000:2.0:1789061951.888819:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120309120:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 4376us (4601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061951.888829:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00010000:00010000:1.0:1789061951.888903:0:8613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.888915:0:8613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.888926:0:8613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.888935:0:8613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.888951:0:8613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789061951.889185:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875967130863872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21531us (22200us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789061951.889193:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789061951.889648:0:3623:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789061951.889656:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1789061951.889680:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9767ffe4a680, transno 4294967310 00000100:00100000:2.0:1789061951.889702:0:3623:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9767ffe48380 x1875967130863872/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789061967 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789061951.889716:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9767ffe48380/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789061951.889723:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130863872:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789061951.890712:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061951.890724:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.890737:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a200 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789061951.890742:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.890755:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.890988:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.890998:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc70b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.891025:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061951.891047:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061951.891050:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061951.897174:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.897240:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120309504 00000100:00100000:1.0:1789061951.897255:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120309504 00000100:00100000:1.0:1789061951.897339:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:1.0:1789061951.897352:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:11380:x1875967120309504:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789061951.897425:0:10077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061951.897460:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc709d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9e6 expref: 16 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.897484:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:1.0:1789061951.897490:0:10077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061951.897530:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc70c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.897547:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc70c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.897559:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc70c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061951.897968:0:10077:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040356fdb reply state 000000002302f908 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc70c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.897987:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc70c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.897994:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:0.0:1789061951.897997:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789061951.898000:0:10077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061951.898447:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:11380:x1875967120309504:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 785us (975us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1789061951.898480:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:2.0:1789061951.901095:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061951.901357:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120309632 00000100:00100000:0.0:1789061951.901371:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120309632 00000100:00100000:0.0:1789061951.901475:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:0.0:1789061951.901487:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120309632:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789061951.901713:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789061951.901717:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789061950 -> 1789061949 00002000:00010000:0.0:1789061951.901720:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789061949 00002000:00010000:0.0:1789061951.901722:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789061950 -> 1789061949 00002000:00010000:0.0:1789061951.901724:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789061951.901810:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2393:x1875967120309632:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 325us (729us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789061951.901818:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:3.0:1789061951.904292:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.909696:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120309888 00000100:00100000:2.0:1789061951.909715:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120309888 00000100:00100000:3.0:1789061951.909964:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:3.0:1789061951.909978:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:11380:x1875967120309888:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789061951.910074:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.910095:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7081 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9d8 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.910106:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.910152:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7081 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9d8 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.910170:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7081 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9d8 expref: 17 pid: 6497 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.910187:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130864384:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061951.910296:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c81e2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789061951.915901:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.916411:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130864384:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061951.916446:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061951.918252:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120310016 00000100:00100000:2.0:1789061951.918270:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120310016 00010000:00010000:2.0:1789061951.918333:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7081 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9d8 expref: 18 pid: 6497 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061951.918387:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 75 00000100:00100000:2.0:1789061951.918399:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:2392:x1875967120310016:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061951.918416:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061951.918424:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7081 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9d8 expref: 18 pid: 6497 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.918440:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7081 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9d8 expref: 18 pid: 6497 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.918466:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7081 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9d8 expref: 18 pid: 6497 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.918487:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:2.0:1789061951.918492:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.918504:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.918527:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.918568:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061951.918677:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:2392:x1875967120310016:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 279us (2789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061951.918710:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 75 00010000:00010000:3.0:1789061951.919030:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.919708:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.919762:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.919781:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.919789:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.919795:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061951.919801:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.919809:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.919824:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:3.0:1789061951.919827:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789061951.919832:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.919838:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70c7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.919923:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:11380:x1875967120309888:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 Request processed in 9945us (15641us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789061951.919933:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:1.0:1789061951.923303:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.923691:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120310144 00000100:00100000:2.0:1789061951.923704:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120310144 00000100:00100000:2.0:1789061951.923788:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1789061951.923800:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2393:x1875967120310144:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789061951.923864:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.923888:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9f4 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.923898:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789061951.923903:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061951.923908:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.923952:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9f4 expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.923969:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9f4 expref: 7 pid: 8412 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061951.923987:0:8411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1875967130864512:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061951.924093:0:8411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767cdb18f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789061951.927475:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061951.927583:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120310272 00000100:00100000:2.0:1789061951.927651:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120310272 00010000:00010000:2.0:1789061951.927703:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9f4 expref: 8 pid: 8412 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061951.927753:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:2.0:1789061951.927773:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120310272:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061951.927794:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061951.927824:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9f4 expref: 8 pid: 8412 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.927841:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9f4 expref: 8 pid: 8412 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.927877:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061951.927883:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061951.927890:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.927903:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.927930:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061951.928016:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120310272:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 252us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061951.928024:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 76 00010000:00010000:1.0:1789061951.928217:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c77a219f/0x2774d8f311dc70ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9f4 expref: 7 pid: 8412 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061951.928235:0:8411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1875967130864512:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061951.928265:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.928287:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.928295:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.928320:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.928330:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.928339:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.928346:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cee00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789061951.928351:0:8411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.928361:0:8411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.928377:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.928397:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e333b21/0x2774d8f311dc70ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061951.928471:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120310144:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 4673us (5181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061951.928480:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:3.0:1789061951.931416:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.931691:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120310528 00000100:00100000:1.0:1789061951.931704:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120310528 00000100:00100000:1.0:1789061951.931789:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:1.0:1789061951.931801:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:11380:x1875967120310528:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789061951.931912:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.931935:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc6fc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a0 expref: 16 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.931946:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.931991:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc6fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a0 expref: 16 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.932007:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc6fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a0 expref: 16 pid: 10077 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061951.932025:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130864640:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061951.932154:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061951.940802:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.940865:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130864640:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061951.940911:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.940965:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120310656 00000100:00100000:3.0:1789061951.940975:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120310656 00010000:00010000:3.0:1789061951.941026:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc6fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a0 expref: 17 pid: 10077 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.941070:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:3.0:1789061951.941083:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:2393:x1875967120310656:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061951.941104:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061951.941112:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc6fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a0 expref: 17 pid: 10077 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.941126:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc6fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a0 expref: 17 pid: 10077 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.941154:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc6fc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9a0 expref: 17 pid: 10077 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.941173:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061951.941179:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc7026 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9c3 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.941192:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.941202:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.941233:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.941265:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061951.941294:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.941303:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.941534:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.941548:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc708f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9df expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.941557:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.941592:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc708f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9df expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.941637:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc708f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9df expref: 17 pid: 6498 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061951.941652:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130864768:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061951.942108:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:2393:x1875967120310656:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1024us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061951.942120:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:1.0:1789061951.944165:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061951.947510:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.947785:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130864768:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061951.947831:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.947941:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120310784 00000100:00100000:3.0:1789061951.947999:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120310784 00010000:00010000:3.0:1789061951.948047:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc708f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9df expref: 17 pid: 6498 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.948130:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:3.0:1789061951.948152:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:2392:x1875967120310784:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061951.948171:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061951.948180:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc708f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9df expref: 17 pid: 6498 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.948193:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc708f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9df expref: 17 pid: 6498 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.948220:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc708f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9df expref: 17 pid: 6498 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.948240:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:3.0:1789061951.948246:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.948258:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.948279:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.948435:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061951.948557:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:2392:x1875967120310784:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 416us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061951.948566:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 78 00010000:00010000:1.0:1789061951.948627:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.948636:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789061951.948799:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1789061951.948946:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1789061951.948988:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1789061951.949087:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1875967130864896:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789061951.949166:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061951.949208:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff97680215de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061951.949456:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130864896 00000100:00100000:2.0:1789061951.949466:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130864896 00000100:00100000:2.0:1789061951.949518:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789061951.949528:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6497:x1875967130864896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789061951.949675:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6497:x1875967130864896:12345-0@lo:1000:mdt00_001.0 Request processed in 148us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061951.949682:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789061951.949841:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f1f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1875967130864896:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789061951.949995:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1789061951.950049:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c3066680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1875967130865024:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789061951.950085:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061951.950112:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789061951.951013:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130865024 00000100:00100000:2.0:1789061951.951023:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130865024 00000100:00100000:2.0:1789061951.951076:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789061951.951086:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6497:x1875967130865024:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789061951.951372:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6497:x1875967130865024:12345-0@lo:1000:mdt00_001.0 Request processed in 287us (1286us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789061951.951380:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789061951.951471:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c3066680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1875967130865024:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789061951.951527:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951538:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951547:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951576:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ac00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061951.951583:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951592:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951644:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:1.0:1789061951.951648:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061951.951655:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951671:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc70dc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951701:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc701f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951708:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc701f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951714:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc701f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951718:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061951.951721:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc701f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951727:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc701f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951747:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061951.951750:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061951.951758:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc7026 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9c3 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951785:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc7026 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9c3 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951796:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc7026 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9c3 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.951838:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc7026 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9c3 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061951.951854:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c76cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130865152:192.168.203.3@tcp:105: 00000100:00100000:1.0:1789061951.951939:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c12ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061951.954102:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.954263:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c76cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130865152:192.168.203.3@tcp:105: 00010000:00010000:1.0:1789061951.954299:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc701f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954312:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc701f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954354:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc70e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954371:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc70e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954403:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc70e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954416:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc70e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954423:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc70e3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954429:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc70e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954436:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061951.954440:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc70e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954447:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc70e3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954463:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061951.954466:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061951.954471:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc70e3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954476:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc70e3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954488:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954494:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954507:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954513:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47be00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061951.954516:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954524:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954532:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061951.954536:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789061951.954539:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061951.954545:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc70d5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.954813:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120310912 00000100:00100000:3.0:1789061951.954824:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120310912 00000100:00100000:3.0:1789061951.954897:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:3.0:1789061951.954910:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:11379:x1875967120310912:12345-192.168.203.3@tcp:49:lfs.0 00000100:00100000:3.0:1789061951.955072:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:11379:x1875967120310912:12345-192.168.203.3@tcp:49:lfs.0 Request processed in 164us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061951.955080:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:1.0:1789061951.957443:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:11380:x1875967120310528:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 25629us (26026us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789061951.957460:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 139 00000020:00080000:1.0:1789061951.957468:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789061951.957862:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061951.957871:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789061951.958382:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.959001:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120311168 00000100:00100000:1.0:1789061951.959014:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120311168 00000100:00100000:1.0:1789061951.959086:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:1.0:1789061951.959097:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:11379:x1875967120311168:12345-192.168.203.3@tcp:58:lfs.0 00000040:00080000:1.0:1789061951.959324:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789061951.959401:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:11379:x1875967120311168:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 304us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061951.959431:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 140 00000040:00080000:0.0:1789061951.960016:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789061951.960032:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789061951.964478:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.964579:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120311424 00000100:00100000:3.0:1789061951.964594:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120311424 00000100:00100000:3.0:1789061951.964763:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:3.0:1789061951.964785:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f06050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:11380:x1875967120311424:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789061951.965167:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789061951.965212:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1789061951.965255:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.965276:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.965533:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.965544:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70ea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.965551:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70ea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.965558:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.965578:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789061951.965797:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061951.965805:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70ea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.965813:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b000 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789061951.965826:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70ea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.965836:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.965851:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:0.0:1789061951.965855:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789061951.965861:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70ea lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.965868:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc70ea lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061951.965881:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061951.965883:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061951.965884:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061951.966001:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f06050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:11380:x1875967120311424:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 1215us (1536us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789061951.966011:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000020:00080000:3.0:1789061951.966018:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789061951.982509:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.982636:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120311552 00000100:00100000:3.0:1789061951.982650:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120311552 00000100:00100000:2.0:1789061951.982857:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:2.0:1789061951.982870:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:11382:x1875967120311552:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061951.982905:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061951.982932:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc70f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3b9fb expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.983015:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc70f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.983033:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc70f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.983070:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc70f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.983087:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc70ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.983095:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc70ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.983102:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc70ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.983215:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7106 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.983229:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9bc expref: 22 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.983238:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7106 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.983281:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9bc expref: 22 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.984523:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9bc expref: 22 pid: 10077 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061951.984552:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130865280:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061951.984711:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061951.989653:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130865280:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061951.989707:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7106 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061951.991044:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061951.991319:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120311808 00000100:00100000:1.0:1789061951.991329:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120311808 00000100:00100000:1.0:1789061951.991400:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:1.0:1789061951.991411:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:6161:x1875967120311808:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789061951.991730:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:6161:x1875967120311808:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 319us (694us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789061951.991739:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:0.0:1789061951.995586:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061951.995792:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120311936 00000100:00100000:3.0:1789061951.995806:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120311936 00010000:00010000:3.0:1789061951.995861:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9bc expref: 24 pid: 10077 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061951.995908:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:3.0:1789061951.995920:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:2392:x1875967120311936:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061951.995939:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061951.995948:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9bc expref: 24 pid: 10077 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.995988:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9bc expref: 24 pid: 10077 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.996016:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7011 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9bc expref: 24 pid: 10077 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.996036:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061951.996044:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7106 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.996056:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.996065:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7106 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061951.996102:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061951.996183:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:2392:x1875967120311936:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 264us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061951.996192:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00010000:00010000:2.0:1789061951.996716:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996726:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061951.996806:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789061951.996812:0:8435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061951.996839:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996855:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996867:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc70f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996875:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc70f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996882:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc70f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996888:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061951.996894:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc70f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996903:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc70f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996926:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:2.0:1789061951.996929:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061951.996934:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc70f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996940:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc70f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996956:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc70ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996963:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc70ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996969:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc70ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996974:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cfa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061951.996976:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc70ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996982:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc70ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.996990:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9767d1235900) 00010000:00010000:2.0:1789061951.996992:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061951.996995:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc70ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.997001:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc70ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.997057:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc70f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9fb expref: 23 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.997072:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9fb expref: 22 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061951.997080:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061951.997082:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061951.997085:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cec00, rc 0) 00000100:00100000:2.0:1789061951.997453:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:11382:x1875967120311552:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 14277us (14654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061951.997461:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 141 00010000:00010000:1.0:1789061952.297880:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061952.684423:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130865408:0@lo:400:kworker.0 00000100:00100000:0.0:1789061952.684524:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061952.684586:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130865920:0@lo:400:kworker.0 00000100:00100000:0.0:1789061952.684663:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061952.684686:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130866432:0@lo:400:kworker.0 00000100:00100000:0.0:1789061952.684714:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061952.685854:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789061952.685868:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130865792:0@lo:400:kworker.0 00000100:00100000:0.0:1789061952.685928:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061952.686207:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130866432 00000100:00100000:3.0:1789061952.686219:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130866432 00000100:00100000:3.0:1789061952.686286:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789061952.686297:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130866432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061952.686372:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130866432:12345-0@lo:400:kworker.0 Request processed in 77us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061952.686379:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789061952.686472:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130866304:0@lo:400:kworker.0 00000100:00100000:0.0:1789061952.686504:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061952.686542:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130866816:0@lo:400:kworker.0 00000100:00100000:0.0:1789061952.686566:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061952.686627:0:3621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1789061952.686634:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1789061952.686661:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9766c77c2300, transno 4294967302 00000004:00080000:0.0:1789061952.686670:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1789061952.686682:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9767ffe49880, transno 4294967305 00000100:00100000:0.0:1789061952.686689:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130866432:0@lo:400:kworker.0 00000100:00100000:0.0:1789061952.686718:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130865536:0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.686876:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130865664:0@lo:400:kworker.0 00000100:00100000:1.0:1789061952.686954:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130865792 00000100:00100000:1.0:1789061952.686959:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130865792 00000100:00100000:1.0:1789061952.686999:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789061952.687007:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130865792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061952.687076:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130866304 00000100:00100000:3.0:1789061952.687081:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130866304 00000100:00100000:3.0:1789061952.687105:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130866816 00000100:00100000:3.0:1789061952.687108:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130866816 00000100:00100000:3.0:1789061952.687136:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789061952.687142:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130866304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.687232:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061952.687260:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130866176:0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.687285:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061952.687304:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130866688:0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.687328:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061952.687364:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130865920 00000100:00100000:2.0:1789061952.687369:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130865920 00000100:00100000:2.0:1789061952.687397:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130865664 00000100:00100000:2.0:1789061952.687400:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130865664 00000100:00100000:2.0:1789061952.687415:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789061952.687421:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130865920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.687468:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130865920:12345-0@lo:400:kworker.0 Request processed in 46us (2804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061952.687483:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789061952.687500:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789061952.687505:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130865664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.687540:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130865664:12345-0@lo:400:kworker.0 Request processed in 35us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061952.687545:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789061952.687563:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130866176 00000100:00100000:2.0:1789061952.687566:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130866176 00000100:00100000:2.0:1789061952.687589:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130866688 00000100:00100000:2.0:1789061952.687592:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130866688 00000100:00100000:2.0:1789061952.687626:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789061952.687634:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130866176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.687666:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130866176:12345-0@lo:400:kworker.0 Request processed in 33us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061952.687672:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789061952.687685:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789061952.687691:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130866688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.687717:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130866688:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061952.687723:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789061952.691121:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130865920:0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.691180:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130865664:0@lo:400:kworker.0 00010000:00080000:2.0:1789061952.691202:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c748f480 x1875967130866176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061952.691214:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130866176:0@lo:400:kworker.0 00010000:00080000:2.0:1789061952.691252:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c748fb80 x1875967130866688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061952.691260:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130866688:0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.692039:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789061952.692055:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130866816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.692172:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130866816:12345-0@lo:400:kworker.0 Request processed in 123us (5604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061952.692180:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789061952.692227:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130866816:0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.692951:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130865792:0@lo:400:kworker.0 00000100:00100000:1.0:1789061952.692996:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130865792:12345-0@lo:400:kworker.0 Request processed in 5731us (6809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061952.693007:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789061952.694933:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130866304:12345-0@lo:400:kworker.0 Request processed in 7782us (8419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061952.694948:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1789061952.694991:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789061952.694999:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061952.695350:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130866304:0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.695716:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130865408 00000100:00100000:2.0:1789061952.695725:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130865408 00000100:00100000:2.0:1789061952.695862:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789061952.695872:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130865408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061952.695960:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130865408:12345-0@lo:400:kworker.0 Request processed in 89us (11436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061952.695967:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789061952.696013:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130865408:0@lo:400:kworker.0 00000100:00100000:0.0:1789061952.696373:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061952.696422:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130866048:0@lo:400:kworker.0 00000100:00100000:0.0:1789061952.696461:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061952.696490:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130866560:0@lo:400:kworker.0 00000100:00100000:0.0:1789061952.696518:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061952.696843:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130865536 00000100:00100000:3.0:1789061952.696851:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130865536 00000100:00100000:3.0:1789061952.696896:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130866048 00000100:00100000:3.0:1789061952.696899:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130866048 00000100:00100000:3.0:1789061952.696926:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130866560 00000100:00100000:3.0:1789061952.696929:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130866560 00000100:00100000:3.0:1789061952.696946:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789061952.696954:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130865536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061952.697002:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130865536:12345-0@lo:400:kworker.0 Request processed in 48us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061952.697007:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789061952.697020:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789061952.697025:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d02b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130866048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061952.697046:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d02b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130866048:12345-0@lo:400:kworker.0 Request processed in 22us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061952.697051:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789061952.697060:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789061952.697064:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130866560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061952.697102:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130866560:12345-0@lo:400:kworker.0 Request processed in 38us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061952.697108:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:3.0:1789061952.697122:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061952.699122:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130865536:0@lo:400:kworker.0 00000100:00100000:0.0:1789061952.699144:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130866048:0@lo:400:kworker.0 00000100:00100000:0.0:1789061952.699157:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130866560:0@lo:400:kworker.0 00000040:00080000:1.0:1789061953.003880:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061953.003894:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061953.003927:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789061953.003937:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061953.004121:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c76cbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13772:1875967130866944:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789061953.004318:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727600 going to sleep for 11 seconds 00000100:00100000:1.0:1789061953.010065:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061953.010155:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120312064 00000100:00100000:3.0:1789061953.010167:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120312064 00000100:00100000:3.0:1789061953.010252:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:3.0:1789061953.010264:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:11394:x1875967120312064:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789061953.010310:0:10077:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789061953.010464:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:11394:x1875967120312064:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 202us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061953.010473:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:2.0:1789061953.010786:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c76cbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13772:1875967130866944:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00080000:1.0:1789061953.011080:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061953.020836:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061953.023942:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120312320 00000100:00100000:1.0:1789061953.023963:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120312320 00000100:00100000:1.0:1789061953.024061:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:1.0:1789061953.024073:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:11394:x1875967120312320:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061953.024102:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061953.024132:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc710d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba02 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061953.024279:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc7114 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061953.024299:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc7114 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061953.024314:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc7114 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061953.024327:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789061953.024469:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc710d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba02 expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061953.024490:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc7114 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba02 expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061953.024499:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061953.024502:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061953.024507:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a800, rc 0) 00000100:00100000:1.0:1789061953.024595:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:11394:x1875967120312320:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 524us (3776us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789061953.024630:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:3.0:1789061953.032139:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061953.032269:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061953.032898:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120312576 00000100:00100000:0.0:1789061953.032913:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120312576 00000100:00100000:0.0:1789061953.032988:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:0.0:1789061953.033001:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:11394:x1875967120312576:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789061953.033115:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc7122 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061953.033139:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc7122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061953.033170:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc7122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061953.033372:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc7122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061953.033381:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc7122 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061953.033390:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc7122 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061953.033397:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061953.033403:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc7122 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061953.033413:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc7122 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061953.033428:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:0.0:1789061953.033431:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789061953.033437:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc7122 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061953.033444:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc7122 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061953.033634:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:11394:x1875967120312576:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 634us (1508us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789061953.033644:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 144 00000040:00080000:3.0:1789061953.033951:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789061953.033957:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789061953.034575:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789061953.034587:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061953.034737:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120312704 00000100:00100000:1.0:1789061953.034756:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120312704 00000100:00100000:1.0:1789061953.034840:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:1.0:1789061953.034852:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:2392:x1875967120312704:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061953.034866:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061953.034892:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc7114 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba02 expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061953.034910:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:1.0:1789061953.034916:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061953.034968:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:2392:x1875967120312704:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 119us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061953.034976:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1789061953.037368:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061953.037553:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120312960 00000100:00100000:1.0:1789061953.037564:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120312960 00000100:00100000:1.0:1789061953.037650:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:1.0:1789061953.037662:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:11394:x1875967120312960:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789061953.037974:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:11394:x1875967120312960:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 313us (616us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789061953.037982:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000040:00080000:0.0:1789061953.114938:0:14234:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061953.114951:0:14234:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789061953.114995:0:14234:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789061953.115005:0:14234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789061953.195068:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061953.195097:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130867072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061953.195189:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061953.195319:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130867328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061953.195421:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130867200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061953.195581:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061953.195680:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130867072 00000100:00100000:3.0:1789061953.195691:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130867072 00000100:00100000:3.0:1789061953.195771:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789061953.195784:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130867072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789061953.195828:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789061953.195963:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130867072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 183us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061953.195971:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789061953.196092:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130867072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789061953.198323:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061953.209908:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130867328 00000100:00100000:1.0:1789061953.209927:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130867328 00000100:00100000:1.0:1789061953.210005:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130867200 00000100:00100000:1.0:1789061953.210008:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130867200 00000100:00100000:1.0:1789061953.210045:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789061953.210056:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130867328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789061953.210097:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789061953.210192:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130867328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (14610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061953.210216:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789061953.210239:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789061953.210245:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875967130867200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061953.210256:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789061953.210285:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875967130867200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (11971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061953.210291:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1789061953.210334:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061953.210987:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130867200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061953.226048:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130867328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789061953.295964:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061953.296051:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120313216 00000100:00100000:3.0:1789061953.296063:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120313216 00000100:00100000:3.0:1789061953.296135:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 145 00000100:00100000:3.0:1789061953.296147:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:11407:x1875967120313216:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789061953.296180:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061953.296206:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7129 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba09 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061953.296345:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7130 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061953.296364:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7130 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061953.296379:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7130 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061953.296391:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789061953.296526:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7129 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba09 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061953.296561:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7130 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba09 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061953.296571:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:3.0:1789061953.296574:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789061953.296578:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807b800, rc 0) 00000100:00100000:3.0:1789061953.299086:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:11407:x1875967120313216:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 2924us (3119us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789061953.299102:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 145 00000100:00100000:3.0:1789061953.303951:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061953.304070:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120313344 00000100:00100000:2.0:1789061953.304083:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120313344 00000100:00100000:2.0:1789061953.304164:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 146 00000100:00100000:2.0:1789061953.304177:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:11407:x1875967120313344:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:2.0:1789061953.304266:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc713e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061953.304289:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc713e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061953.304303:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc713e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061953.304350:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc713e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061953.304359:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc713e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061953.304367:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc713e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061953.304374:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061953.304379:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc713e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061953.304387:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc713e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061953.304401:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:2.0:1789061953.304418:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061953.304426:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc713e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061953.304432:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc713e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061953.304525:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:11407:x1875967120313344:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 350us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061953.304533:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 146 00010000:00010000:3.0:1789061953.321890:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061953.404850:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061953.405024:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120313472 00000100:00100000:1.0:1789061953.405038:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120313472 00000100:00100000:1.0:1789061953.405209:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:1.0:1789061953.405225:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2390:x1875967120313472:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:1.0:1789061953.405252:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061953.405280:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdadce1f/0x2774d8f311dc7145 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba10 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061953.405315:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa2eb3d, atime: 0x6aa2eb3d, ctime: 0x6aa2eb3d, blocks: 0x8 00010000:00010000:1.0:1789061953.405342:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1789061953.405348:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061953.405361:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdadce1f/0x2774d8f311dc7145 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba10 expref: 7 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061953.405385:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fdadce1f/0x2774d8f311dc7145 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba10 expref: 7 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061953.405428:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a800, rc 0) 00000100:00100000:1.0:1789061953.405505:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2390:x1875967120313472:12345-192.168.203.3@tcp:101:cat.0 Request processed in 285us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061953.405513:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00080000:2.0:1789061953.405753:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789061953.416073:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061953.416155:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120313600 00000100:00100000:0.0:1789061953.416168:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120313600 00002000:00100000:0.0:1789061953.416229:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9766c748d180 x1875967120313600/t0(0) o3->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:374/0 lens 488/0 e 0 to 0 dl 1789061964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061953.416243:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c748d180 with x1875967120313600 ext(0->4095) 00002000:00010000:0.0:1789061953.416250:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c748d180 00000100:00100000:0.0:1789061953.416280:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1789061953.416290:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2392:x1875967120313600:12345-192.168.203.3@tcp:3:cat.0 00000100:00100000:0.0:1789061953.416502:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2392:x1875967120313600:12345-192.168.203.3@tcp:3:cat.0 Request processed in 212us (441us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789061953.416510:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00002000:00100000:0.0:1789061953.416517:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9766c748d180 x1875967120313600/t0(0) o3->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:374/0 lens 488/4536 e 0 to 0 dl 1789061964 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061953.416526:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c748d180 with x1875967120313600 ext(0->4095) 00002000:00010000:0.0:1789061953.416529:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c748d180 00010000:00010000:0.0:1789061954.346220:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061955.369782:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061955.754007:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130867456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789061955.754072:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061955.754304:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130867456 00000100:00100000:2.0:1789061955.754315:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130867456 00000100:00100000:2.0:1789061955.754389:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789061955.754399:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130867456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789061955.754432:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789061955.755691:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130867456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1288us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061955.755702:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789061955.755970:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130867456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789061956.266947:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130867584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061956.267017:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061956.267216:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130867584 00000100:00100000:0.0:1789061956.267237:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130867584 00000100:00100000:0.0:1789061956.267304:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789061956.267315:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130867584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061956.267342:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061956.267389:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130867584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061956.267396:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1789061956.267453:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061956.267490:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130867584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061956.273603:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c76c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130867712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061956.273698:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061956.273776:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130867712 00000100:00100000:1.0:1789061956.273783:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130867712 00000100:00100000:1.0:1789061956.273834:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789061956.273843:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130867712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789061956.273863:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061956.273904:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130867712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061956.273910:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1789061956.273931:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061956.273962:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c76c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130867712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789061956.362067:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061956.362118:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061956.362152:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061956.362183:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061956.362206:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061956.362225:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061956.362244:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061956.362273:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120313984 00000100:00100000:0.0:1789061956.362281:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120313984 00000100:00100000:0.0:1789061956.362331:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120314496 00000100:00100000:0.0:1789061956.362335:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120314496 00000100:00100000:0.0:1789061956.362348:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120313856 00000100:00100000:0.0:1789061956.362351:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120313856 00000100:00100000:0.0:1789061956.362365:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120314368 00000100:00100000:0.0:1789061956.362367:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120314368 00000100:00100000:0.0:1789061956.362381:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 278 00000100:00100000:0.0:1789061956.362391:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120313984:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061956.362463:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120313984:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 73us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061956.362471:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 278 00000100:00100000:0.0:1789061956.362489:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 279 00000100:00100000:0.0:1789061956.362511:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120314496:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061956.362539:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120314496:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 30us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061956.362545:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 279 00000100:00100000:0.0:1789061956.362558:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 280 00000100:00100000:0.0:1789061956.362564:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:2391:x1875967120313856:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061956.362586:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:2391:x1875967120313856:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061956.362592:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 280 00000100:00100000:0.0:1789061956.362602:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 281 00000100:00100000:0.0:1789061956.362660:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120314368:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061956.362685:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120314368:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061956.362691:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 281 00000100:00100000:0.0:1789061956.362713:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120314240 00000100:00100000:0.0:1789061956.362717:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120314240 00000100:00100000:0.0:1789061956.362754:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120314112 00000100:00100000:0.0:1789061956.362757:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120314112 00000100:00100000:0.0:1789061956.362779:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:0.0:1789061956.362785:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2391:x1875967120314240:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061956.362811:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2391:x1875967120314240:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061956.362817:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:0.0:1789061956.362829:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:0.0:1789061956.362835:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120314112:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061956.362869:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120314112:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061956.362876:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00080000:1.0:1789061956.363379:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061956.363390:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061956.363393:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061956.363395:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789061956.363459:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120313728 00000100:00100000:2.0:1789061956.363465:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120313728 00000100:00100000:2.0:1789061956.363503:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 378 00000100:00100000:2.0:1789061956.363510:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120313728:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061956.363554:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3369850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120313728:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 45us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061956.363561:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 378 00010000:00010000:3.0:1789061956.394047:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061957.422846:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061957.803650:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130868224:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.803742:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.803789:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130868736:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.803813:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.803827:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130869248:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.803843:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.803862:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789061957.803868:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130867840:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.803890:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.803910:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130868352:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.803929:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.803946:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fb0aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130868864:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.803962:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.803976:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130869376:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.803994:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.804474:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130867968:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.804523:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.804546:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130868480:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.804569:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.804585:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130868992:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.804655:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.804675:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789061957.804681:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130868096:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.804715:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.808404:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130868608:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.808463:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.808488:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130869120:0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.808513:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061957.808552:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130868224 00000100:00100000:0.0:1789061957.808561:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130868224 00000100:00100000:0.0:1789061957.808602:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130867968 00000100:00100000:0.0:1789061957.808627:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130867968 00000100:00100000:0.0:1789061957.808648:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130868480 00000100:00100000:0.0:1789061957.808651:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130868480 00000100:00100000:2.0:1789061957.808668:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130868352 00000100:00100000:2.0:1789061957.808675:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130868352 00000100:00100000:0.0:1789061957.808680:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130868992 00000100:00100000:0.0:1789061957.808685:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130868992 00000100:00100000:2.0:1789061957.808708:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130868096 00000100:00100000:2.0:1789061957.808713:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130868096 00000100:00100000:2.0:1789061957.808742:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789061957.808751:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130868352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061957.808823:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130868352:12345-0@lo:400:kworker.0 Request processed in 73us (4891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061957.808830:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789061957.808849:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789061957.808857:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130868096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061957.808895:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130868096:12345-0@lo:400:kworker.0 Request processed in 39us (4179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061957.808901:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789061957.809893:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130868608 00000100:00100000:0.0:1789061957.809900:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130868608 00000100:00100000:0.0:1789061957.809923:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130869120 00000100:00100000:0.0:1789061957.809926:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130869120 00000100:00100000:0.0:1789061957.809945:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789061957.809953:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f4570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130868224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.810004:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f4570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130868224:12345-0@lo:400:kworker.0 Request processed in 52us (6262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061957.810010:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789061957.810141:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130868736 00000100:00100000:1.0:1789061957.810145:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130868736 00000100:00100000:1.0:1789061957.810167:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130869248 00000100:00100000:1.0:1789061957.810184:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130869248 00000100:00100000:1.0:1789061957.810200:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130868864 00000100:00100000:1.0:1789061957.810202:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130868864 00000100:00100000:1.0:1789061957.810212:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130869376 00000100:00100000:1.0:1789061957.810214:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130869376 00000100:00100000:1.0:1789061957.810226:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789061957.810231:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130868736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061957.810266:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130868736:12345-0@lo:400:kworker.0 Request processed in 34us (6452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061957.810272:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789061957.810286:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789061957.810291:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130869248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061957.810324:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130869248:12345-0@lo:400:kworker.0 Request processed in 33us (6480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061957.810329:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789061957.810339:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789061957.810345:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130868864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061957.810371:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130868864:12345-0@lo:400:kworker.0 Request processed in 27us (6407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061957.810377:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789061957.810387:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789061957.810393:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3622:x1875967130869376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061957.810447:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3622:x1875967130869376:12345-0@lo:400:kworker.0 Request processed in 54us (6451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061957.810452:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789061957.810479:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130867840 00000100:00100000:1.0:1789061957.810483:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130867840 00000100:00100000:1.0:1789061957.810510:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789061957.810516:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130867840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.810601:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789061957.810629:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130867968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.810662:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130867968:12345-0@lo:400:kworker.0 Request processed in 36us (6139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061957.810675:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789061957.810690:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789061957.810696:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130868480:12345-0@lo:400:kworker.0 00000001:00080000:2.0:1789061957.810801:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000100:00100000:0.0:1789061957.810820:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130868480:12345-0@lo:400:kworker.0 Request processed in 121us (6248us total) trans 0 rc 0/0 00000001:00080000:2.0:1789061957.810821:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:0.0:1789061957.810830:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789061957.810848:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789061957.810855:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130868992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.810882:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130868992:12345-0@lo:400:kworker.0 Request processed in 29us (6228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061957.810887:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789061957.810899:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789061957.810906:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130868608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.810932:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130868608:12345-0@lo:400:kworker.0 Request processed in 27us (2470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061957.810938:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789061957.810949:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789061957.810955:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130869120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061957.810993:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130869120:12345-0@lo:400:kworker.0 Request processed in 37us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061957.810999:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:2.0:1789061957.811811:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061957.811818:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789061957.811821:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061957.811859:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130868352:0@lo:400:kworker.0 00000100:00100000:2.0:1789061957.811873:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130868864:0@lo:400:kworker.0 00000100:00100000:2.0:1789061957.811886:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130869376:0@lo:400:kworker.0 00000100:00100000:2.0:1789061957.811899:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130868224:0@lo:400:kworker.0 00000100:00100000:2.0:1789061957.811910:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fb0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130868736:0@lo:400:kworker.0 00000100:00100000:2.0:1789061957.811921:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130869248:0@lo:400:kworker.0 00000100:00100000:1.0:1789061957.811941:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130867840:12345-0@lo:400:kworker.0 Request processed in 1423us (8048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061957.811951:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789061957.811972:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130867840:0@lo:400:kworker.0 00000100:00100000:2.0:1789061957.812004:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130868096:0@lo:400:kworker.0 00010000:00080000:2.0:1789061957.812031:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd514a80 x1875967130868608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061957.812041:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130868608:0@lo:400:kworker.0 00010000:00080000:2.0:1789061957.812054:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c8f7f100 x1875967130869120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061957.812062:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130869120:0@lo:400:kworker.0 00000100:00100000:2.0:1789061957.812075:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130867968:0@lo:400:kworker.0 00000100:00100000:2.0:1789061957.812085:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130868480:0@lo:400:kworker.0 00000100:00100000:2.0:1789061957.812095:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130868992:0@lo:400:kworker.0 00000001:00080000:1.0:1789061957.817359:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1789061957.817392:0:6474:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9767cdb18f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789061957.817398:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767ffd79b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9767c1455300 00000020:00080000:1.0:1789061957.817401:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767ffd79800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9766c64ef400 00000020:00080000:1.0:1789061957.817422:0:6474:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789061957.817435:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789061957.817503:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1789061957.817734:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc70c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061957.817747:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc70c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061957.817767:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc70c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061957.817773:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061957.817778:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc70c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061957.817786:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc70c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061957.817802:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9767fd592600) 00010000:00010000:0.0:1789061957.817805:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061957.817810:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc70c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061957.817818:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc70c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061958.065879:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061958.068802:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120314624 00000100:00100000:2.0:1789061958.068823:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120314624 00000100:00100000:2.0:1789061958.069030:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:2.0:1789061958.069045:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:11068:x1875967120314624:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789061958.069230:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:11068:x1875967120314624:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 190us (3366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061958.069239:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00080000:1.0:1789061958.070010:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789061958.074441:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061958.074556:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120314752 00000100:00100000:0.0:1789061958.074568:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120314752 00000100:00080000:1.0:1789061958.074699:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789061958.074820:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:0.0:1789061958.074834:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c76c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:11068:x1875967120314752:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789061958.075311:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c76c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:11068:x1875967120314752:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 478us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061958.075321:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:3.0:1789061958.077858:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061958.085243:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120315008 00000100:00100000:2.0:1789061958.085268:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120315008 00000100:00100000:2.0:1789061958.085354:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:2.0:1789061958.085366:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:11068:x1875967120315008:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789061958.085752:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:11068:x1875967120315008:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 387us (7908us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789061958.085762:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000040:00080000:0.0:1789061958.185923:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061958.185937:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789061958.185992:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789061958.186003:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061958.314358:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130869632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061958.314459:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061958.314492:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130869760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061958.314527:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061958.314549:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061958.314557:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130869504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061958.314575:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130869760 00000100:00100000:1.0:1789061958.314581:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061958.314584:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130869760 00000100:00100000:1.0:1789061958.314634:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130869504 00000100:00100000:1.0:1789061958.314654:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130869504 00000100:00100000:1.0:1789061958.314704:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789061958.314805:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130869504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061958.314845:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789061958.314898:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130869504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061958.314948:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130869632 00000100:00100000:3.0:1789061958.314954:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130869632 00000100:00100000:3.0:1789061958.314987:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789061958.314995:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130869632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789061958.315023:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789061958.315063:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130869632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061958.315069:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789061958.319986:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789061958.320027:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130869760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789061958.320068:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789061958.320217:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130869760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 213us (5687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061958.320226:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789061958.320362:0:3621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1789061958.320368:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9767ffe48380, transno 4294967311 00000004:00080000:0.0:1789061958.320385:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1789061958.320437:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130869504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061958.320459:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130869632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061958.321062:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130869760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061958.323431:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00010000:1.0:1789061958.441866:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789061958.506382:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789061959.466894:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789061959.992590:0:14432:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 13:39:17 (1789061957) 00010000:00010000:2.0:1789061960.489963:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061960.874012:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130869888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789061960.874120:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061960.874390:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130869888 00000100:00100000:3.0:1789061960.874400:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130869888 00000100:00100000:3.0:1789061960.874494:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789061960.874505:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130869888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789061960.874550:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789061960.880764:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130869888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6247us (6630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061960.880782:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789061960.880952:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130869888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789061961.386661:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789061961.386692:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130870016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061961.386796:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061961.386886:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130870016 00000100:00100000:0.0:1789061961.386895:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130870016 00000100:00080000:3.0:1789061961.386954:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061961.386970:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789061961.386981:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130870016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789061961.387019:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061961.387093:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130870016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061961.387101:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789061961.387537:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767ffe27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130870144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789061961.387576:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061961.387928:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130870016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061961.387964:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130870144 00000100:00100000:3.0:1789061961.387969:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130870144 00000100:00100000:3.0:1789061961.388013:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789061961.388022:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130870144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789061961.388037:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061961.388076:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130870144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061961.388083:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1789061961.388101:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061961.388124:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767ffe27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130870144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789061961.439014:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061961.440862:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120315264 00000100:00100000:0.0:1789061961.440891:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120315264 00000100:00100000:0.0:1789061961.441016:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:0.0:1789061961.441028:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:12125:x1875967120315264:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061961.441062:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061961.441099:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc714c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789061961.441402:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789061961.441585:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7153 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.441603:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7153 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.441664:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7153 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.441683:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc715a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.441691:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc715a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.441714:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc715a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.441842:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc7161 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.441874:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc7161 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.441882:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc7161 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061961.441894:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789061961.442009:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7153 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442017:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7153 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442025:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7153 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442032:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061961.442038:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7153 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442047:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7153 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442059:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9767c72b9800) 00010000:00010000:0.0:1789061961.442062:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061961.442825:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7153 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442837:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7153 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442856:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc715a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442875:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc715a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442881:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc715a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442887:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061961.442890:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc715a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442897:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc715a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442909:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9767f385f100) 00010000:00010000:0.0:1789061961.442912:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061961.442914:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc715a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.442920:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc715a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.446580:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc714c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba17 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.446652:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc7161 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba17 expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061961.446664:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c7417500) 00010000:00010000:0.0:1789061961.446668:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061961.447831:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199400, rc 0) 00000100:00100000:0.0:1789061961.447945:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:12125:x1875967120315264:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 6915us (8941us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789061961.447957:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:2.0:1789061961.451564:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061961.452488:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061961.452640:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120315520 00000100:00100000:3.0:1789061961.452653:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120315520 00000100:00100000:3.0:1789061961.452746:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1789061961.452770:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:2390:x1875967120315520:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061961.452811:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061961.452845:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc7161 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba17 expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061961.452868:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c7417500) 00010000:00010000:3.0:1789061961.452873:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061961.452944:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:2390:x1875967120315520:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 186us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061961.452960:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1789061961.455375:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120315392 00000100:00100000:0.0:1789061961.455397:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120315392 00000100:00100000:0.0:1789061961.455569:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:0.0:1789061961.455582:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:12125:x1875967120315392:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789061961.456911:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:12125:x1875967120315392:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 1321us (5350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061961.456925:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:1.0:1789061961.463420:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061961.463577:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120315648 00000100:00100000:0.0:1789061961.463600:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120315648 00000100:00100000:1.0:1789061961.468126:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:1.0:1789061961.468147:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:12125:x1875967120315648:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1789061961.468360:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061961.468504:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:12125:x1875967120315648:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 362us (5107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061961.468514:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:2.0:1789061961.494557:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061961.494709:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120315776 00000100:00100000:0.0:1789061961.494722:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120315776 00000100:00100000:0.0:1789061961.494814:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 380 00000100:00100000:0.0:1789061961.494826:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2392:x1875967120315776:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061961.494937:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2392:x1875967120315776:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 113us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061961.494945:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 380 00000100:00100000:2.0:1789061961.497153:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061961.497269:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061961.504382:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120315904 00000100:00100000:0.0:1789061961.504407:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120315904 00000100:00100000:2.0:1789061961.505397:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061961.505963:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061961.505991:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061961.506114:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120316160 00000100:00100000:1.0:1789061961.506125:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120316160 00000100:00100000:1.0:1789061961.506198:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120316288 00000100:00100000:1.0:1789061961.506202:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120316288 00000100:00100000:1.0:1789061961.507673:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:1.0:1789061961.507706:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c6248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120316160:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061961.507825:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c6248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120316160:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 141us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061961.507853:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:1.0:1789061961.507877:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:1.0:1789061961.507885:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120316288:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061961.507914:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120316288:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 31us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061961.507920:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00080000:1.0:1789061961.507951:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061961.507958:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061961.508963:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120316032 00000100:00100000:2.0:1789061961.509173:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061961.509315:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120316416 00000100:00100000:2.0:1789061961.509324:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120316416 00000100:00100000:2.0:1789061961.509379:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120316544 00000100:00100000:2.0:1789061961.509382:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120316544 00000100:00100000:2.0:1789061961.509403:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 288 00000100:00100000:3.0:1789061961.509584:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120316032 00000100:00080000:3.0:1789061961.509724:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789061961.509729:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061961.509754:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 289 00000100:00100000:3.0:1789061961.509766:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2392:x1875967120316416:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061961.510353:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2392:x1875967120316416:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 588us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061961.510362:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 289 00000100:00100000:3.0:1789061961.510389:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 290 00000100:00100000:3.0:1789061961.510396:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2392:x1875967120316544:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061961.510574:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:2392:x1875967120315904:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789061961.510735:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:2392:x1875967120315904:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1323us (13663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061961.510743:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 288 00000100:00100000:3.0:1789061961.510970:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2392:x1875967120316544:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 574us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061961.511104:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 290 00000100:00100000:3.0:1789061961.511191:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 291 00000100:00100000:3.0:1789061961.511210:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120316032:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061961.511260:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120316032:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 62us (13990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061961.511267:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 291 00010000:00010000:2.0:1789061961.514379:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789061961.580948:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789061962.281866:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061962.281875:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061962.281895:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789061962.281902:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789061962.539106:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061962.921985:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130870656:0@lo:400:kworker.0 00000100:00100000:0.0:1789061962.922049:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061962.922098:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130871168:0@lo:400:kworker.0 00000100:00100000:0.0:1789061962.922122:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061962.922145:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130871680:0@lo:400:kworker.0 00000100:00100000:0.0:1789061962.922165:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061962.922185:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789061962.922191:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130870528:0@lo:400:kworker.0 00000100:00100000:0.0:1789061962.922212:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061962.922229:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130871040:0@lo:400:kworker.0 00000100:00100000:0.0:1789061962.922248:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061962.922269:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130871552:0@lo:400:kworker.0 00000100:00100000:0.0:1789061962.922287:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061962.922317:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130870656 00000100:00100000:0.0:1789061962.922324:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130870656 00000100:00100000:0.0:1789061962.922375:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130871040 00000100:00100000:0.0:1789061962.922378:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130871040 00000100:00100000:0.0:1789061962.922403:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130871552 00000100:00100000:0.0:1789061962.922405:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130871552 00000100:00100000:0.0:1789061962.922420:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789061962.922427:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130870656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061962.922478:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130870656:12345-0@lo:400:kworker.0 Request processed in 51us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061962.922484:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789061962.922500:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789061962.922507:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130871040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.922599:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130870272:0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.922650:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061962.922801:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130870784:0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.922835:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061962.922858:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130871296:0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.923161:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061962.923184:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130871808:0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.923206:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061962.923227:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789061962.923233:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130870400:0@lo:400:kworker.0 00000100:00100000:3.0:1789061962.923380:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789061962.923380:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061962.923391:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130871552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.923399:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130870912:0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.923418:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061962.923425:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130871552:12345-0@lo:400:kworker.0 Request processed in 38us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061962.923427:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130871424:0@lo:400:kworker.0 00000100:00100000:3.0:1789061962.923431:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789061962.923443:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061962.923444:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130870400 00000100:00100000:3.0:1789061962.923449:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130870400 00000100:00100000:3.0:1789061962.923464:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789061962.923466:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130871168 00000100:00100000:3.0:1789061962.923469:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130870400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.923469:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130871168 00000100:00100000:1.0:1789061962.923489:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130871680 00000100:00100000:1.0:1789061962.923491:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130871680 00000100:00100000:3.0:1789061962.923497:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130870400:12345-0@lo:400:kworker.0 Request processed in 29us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061962.923503:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789061962.923505:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130871296 00000100:00100000:1.0:1789061962.923507:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130871296 00000100:00100000:3.0:1789061962.923512:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130870912 00000100:00100000:3.0:1789061962.923515:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130870912 00000100:00100000:1.0:1789061962.923515:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130871808 00000100:00100000:1.0:1789061962.923517:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130871808 00000100:00100000:3.0:1789061962.923525:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130871424 00000100:00100000:3.0:1789061962.923527:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130871424 00000100:00100000:1.0:1789061962.923528:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789061962.923533:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130871168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061962.923539:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789061962.923543:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130870912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.923562:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130871168:12345-0@lo:400:kworker.0 Request processed in 29us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061962.923563:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130870912:12345-0@lo:400:kworker.0 Request processed in 20us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061962.923568:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789061962.923568:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789061962.923578:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789061962.923579:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789061962.923585:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130871680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.923633:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130871680:12345-0@lo:400:kworker.0 Request processed in 48us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061962.923639:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789061962.923652:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789061962.923757:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130870400:0@lo:400:kworker.0 00000100:00100000:2.0:1789061962.923768:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130870912:0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.923791:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130871296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.923831:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130871296:12345-0@lo:400:kworker.0 Request processed in 43us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061962.923837:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789061962.923841:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130871424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.923854:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789061962.923859:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130871808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.923954:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130871808:12345-0@lo:400:kworker.0 Request processed in 94us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061962.923959:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789061962.924048:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130870272 00000100:00100000:1.0:1789061962.924054:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130870272 00000100:00100000:1.0:1789061962.924154:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789061962.924161:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130870272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.924191:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130870272:12345-0@lo:400:kworker.0 Request processed in 31us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061962.924197:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789061962.924221:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130871424:12345-0@lo:400:kworker.0 Request processed in 381us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061962.924224:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130870528 00000100:00100000:3.0:1789061962.924227:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789061962.924227:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130870528 00000100:00100000:1.0:1789061962.924382:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130870784 00000100:00100000:1.0:1789061962.924386:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130870784 00000100:00100000:2.0:1789061962.924398:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130871424:0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.924402:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789061962.924407:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130870272:0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.924407:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130870528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061962.924416:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130871296:0@lo:400:kworker.0 00000100:00100000:2.0:1789061962.924424:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130871808:0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.924437:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130870528:12345-0@lo:400:kworker.0 Request processed in 30us (2224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061962.924443:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789061962.924454:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789061962.924460:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130870784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061962.924497:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130870784:12345-0@lo:400:kworker.0 Request processed in 37us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061962.924502:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789061962.924757:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130870784:0@lo:400:kworker.0 00000100:00080000:2.0:1789061962.925003:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789061962.925009:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061962.925011:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789061962.925199:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130870528:0@lo:400:kworker.0 00010000:00080000:2.0:1789061962.925222:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c7561500 x1875967130871552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061962.925232:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130871552:0@lo:400:kworker.0 00000100:00100000:2.0:1789061962.925242:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130870656:0@lo:400:kworker.0 00000100:00100000:2.0:1789061962.925251:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130871168:0@lo:400:kworker.0 00000100:00100000:2.0:1789061962.925261:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130871680:0@lo:400:kworker.0 00000100:00100000:0.0:1789061962.925373:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130871040:12345-0@lo:400:kworker.0 Request processed in 2866us (3123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061962.925395:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00010000:00080000:2.0:1789061962.925420:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c80a2300 x1875967130871040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061962.925431:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130871040:0@lo:400:kworker.0 00000100:00100000:0.0:1789061963.198034:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.198221:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120316672 00000100:00100000:2.0:1789061963.198232:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120316672 00000100:00100000:2.0:1789061963.198300:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:2.0:1789061963.198317:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:12167:x1875967120316672:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061963.198335:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061963.198356:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc716f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba1e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198416:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7176 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198430:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198443:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198457:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc717d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198464:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc717d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198471:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc717d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198513:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198520:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7176 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198526:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198539:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061963.198544:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198551:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7176 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198563:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fd592800) 00010000:00010000:2.0:1789061963.198566:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061963.198572:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198579:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.198590:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc717d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789061963.198985:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789061963.199559:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc717d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.199565:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc717d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.199570:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cee00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061963.199574:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc717d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.199581:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc717d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.199694:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9767d1235200) 00010000:00010000:2.0:1789061963.199697:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061963.199701:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc717d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.199707:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc717d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.199750:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc716f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba1e expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.199760:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fd592800) 00010000:00010000:2.0:1789061963.199763:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061963.199767:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc716f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba1e expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.199777:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cf800, rc 0) 00000100:00100000:2.0:1789061963.200211:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:12167:x1875967120316672:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1895us (2183us total) trans 0 rc 301/301 00000100:00100000:2.0:1789061963.200220:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:2.0:1789061963.210360:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.210393:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120316928 00000100:00100000:2.0:1789061963.210402:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120316928 00000100:00100000:2.0:1789061963.210449:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 153 00000100:00100000:2.0:1789061963.210458:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+15:12167:x1875967120316928:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:2.0:1789061963.210508:0:10077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061963.210531:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc6ad1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b849 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.210555:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767fd592800) 00010000:00010000:2.0:1789061963.210565:0:10077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061963.210818:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7184 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.210903:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7184 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.210915:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7184 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.210930:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc718b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.210938:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc718b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.210944:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc718b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.211557:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7192 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.211569:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7192 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.211924:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7192 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061963.211947:0:10077:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b38b2a0 reply state 0000000020a381cf transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7192 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.211971:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7192 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.211978:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235f00) 00010000:00010000:2.0:1789061963.211981:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789061963.211984:0:10077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789061963.211990:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789061963.211997:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7184 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.212004:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7184 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.212011:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7184 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.212017:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061963.212021:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7184 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.212029:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7184 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.212038:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d1235200) 00010000:00010000:2.0:1789061963.212041:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061963.212044:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7184 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.212050:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7184 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061963.212087:0:10077:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b38b2a0 reply state 0000000020a381cf transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc718b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.212096:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc718b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.212102:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9767d1235500) 00010000:00010000:2.0:1789061963.212104:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789061963.212106:0:10077:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789061963.212988:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+16:12167:x1875967120316928:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 2525us (2631us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789061963.212999:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 153 00000001:00080000:2.0:1789061963.213966:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000020:00080000:2.0:1789061963.213983:0:6474:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789061963.214024:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789061963.214041:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789061963.214098:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc718b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214109:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc718b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214115:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc718b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214121:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cee00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061963.214125:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc718b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214132:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc718b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214146:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9767d1235500) 00010000:00010000:0.0:1789061963.214149:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061963.214152:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc718b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214159:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc718b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214179:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7192 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214185:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7192 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214191:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7192 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214207:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061963.214210:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7192 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214216:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7192 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214225:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235f00) 00010000:00010000:0.0:1789061963.214227:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061963.214230:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7192 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.214235:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7192 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061963.304199:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061963.304311:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120317056 00000100:00100000:0.0:1789061963.304321:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120317056 00000100:00100000:0.0:1789061963.304381:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 154 00000100:00100000:0.0:1789061963.304390:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+12:12175:x1875967120317056:12345-192.168.203.3@tcp:101:lctl.0 00010000:00010000:0.0:1789061963.304412:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061963.304433:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7199 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba25 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.304505:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc71a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.304518:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc71a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.304530:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc71a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061963.304599:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789061963.304640:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789061963.304665:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc71a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.304700:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba25 expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.304718:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc71a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba25 expref: 13 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.304727:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767f385f100) 00010000:00010000:0.0:1789061963.304730:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061963.304734:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199e00, rc 0) 00000100:00100000:2.0:1789061963.305192:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:12175:x1875967120317056:12345-192.168.203.3@tcp:101:lctl.0 Request processed in 802us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061963.305200:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 154 00000100:00100000:0.0:1789061963.371729:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.374221:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120317184 00000100:00100000:2.0:1789061963.374235:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120317184 00000100:00100000:2.0:1789061963.374627:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 155 00000100:00100000:2.0:1789061963.374638:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:12181:x1875967120317184:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1789061963.374658:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061963.374677:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc71a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba2c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.374751:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.374777:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.374789:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.374814:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.374822:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.374829:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.374904:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc71bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.374911:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc71bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.374918:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc71bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061963.375245:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789061963.375249:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061963.375269:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc71bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375281:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375300:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375305:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375310:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061963.375314:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375322:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375332:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767f385f100) 00010000:00010000:2.0:1789061963.375335:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061963.375339:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375414:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375429:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375434:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375439:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375443:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cfa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061963.375462:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375469:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375478:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9767d1235200) 00010000:00010000:2.0:1789061963.375485:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061963.375489:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375495:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375532:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc71a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba2c expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375545:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc71bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba2c expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.375552:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:2.0:1789061963.375554:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789061963.375556:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce200, rc 0) 00000100:00100000:2.0:1789061963.375668:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:12181:x1875967120317184:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1032us (3947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061963.375675:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 155 00000100:00100000:3.0:1789061963.381051:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.381244:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120317440 00000100:00100000:2.0:1789061963.381253:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120317440 00000100:00100000:2.0:1789061963.381312:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 156 00000100:00100000:2.0:1789061963.381322:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:12181:x1875967120317440:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1789061963.381355:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061963.381374:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc71c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba33 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.381476:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.381490:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.381500:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.381550:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.381558:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.381565:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789061963.381907:0:8435:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789061963.382278:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc71d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382289:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc71d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382297:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc71d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382353:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382361:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71ca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382367:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382373:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cfa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061963.382377:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382385:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382396:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:2.0:1789061963.382398:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061963.382403:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71ca lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382408:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc71ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061963.382421:0:8435:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c22155b7 reply state 0000000029f56d2d transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382432:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382438:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767d1235200) 00010000:00010000:2.0:1789061963.382456:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789061963.382460:0:8435:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789061963.382489:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc71c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba33 expref: 17 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382504:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc71d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba33 expref: 16 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.382511:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767d1235000) 00010000:00010000:2.0:1789061963.382513:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061963.382515:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cf600, rc 0) 00000100:00100000:2.0:1789061963.382587:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:12181:x1875967120317440:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1267us (1548us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1789061963.382594:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 156 00000100:00100000:3.0:1789061963.388537:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061963.388635:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120317568 00000100:00100000:1.0:1789061963.388645:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120317568 00000100:00100000:1.0:1789061963.388724:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:1.0:1789061963.388740:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2392:x1875967120317568:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1789061963.388757:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061963.388777:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc71e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba3a expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061963.388802:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789061963.388821:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:1.0:1789061963.388825:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061963.388834:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc71e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba3a expref: 6 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.388851:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc71e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba3a expref: 6 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.388864:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47ba00, rc 0) 00000100:00100000:1.0:1789061963.388920:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120317568:12345-192.168.203.3@tcp:101:bash.0 Request processed in 182us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061963.388926:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00080000:0.0:1789061963.389031:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061963.394416:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061963.395476:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120317696 00000100:00100000:1.0:1789061963.395488:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120317696 00000100:00100000:1.0:1789061963.395556:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:1.0:1789061963.395567:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:12181:x1875967120317696:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1789061963.395598:0:8613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061963.395648:0:8613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba41 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.395678:0:8613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc71e6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba3a expref: 7 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.395698:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061963.395702:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061963.395708:0:8613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 7 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.395741:0:8613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc71e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba3a expref: 7 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.395755:0:8613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc71e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba3a expref: 7 pid: 8413 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061963.395768:0:8613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8613:1875967130871936:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061963.395859:0:8613:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6750600 going to sleep for 11 seconds 00000100:00100000:3.0:1789061963.401359:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061963.401575:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120317824 00000100:00100000:0.0:1789061963.401595:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120317824 00010000:00010000:0.0:1789061963.401676:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc71e6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba3a expref: 8 pid: 8413 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061963.401726:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:0.0:1789061963.401736:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3066680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120317824:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061963.401750:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061963.401771:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc71e6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba3a expref: 8 pid: 8413 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.401804:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc71e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba3a expref: 8 pid: 8413 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.401829:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061963.401833:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061963.401842:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 8 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.401853:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 8 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.401888:0:9499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 8 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061963.401902:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7563800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9499:1875967130872064:192.168.203.3@tcp:105: 00000100:00100000:0.0:1789061963.401998:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826e240 going to sleep for 11 seconds 00010000:00010000:1.0:1789061963.403194:0:8613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc71e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba3a expref: 8 pid: 8413 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061963.403214:0:8613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8613:1875967130871936:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061963.403240:0:8613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 7 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.403265:0:8613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a000, rc 0) 00000100:00100000:1.0:1789061963.403317:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:12181:x1875967120317696:12345-192.168.203.3@tcp:101:bash.0 Request processed in 7751us (8908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061963.403325:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:0.0:1789061963.412486:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7563800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9499:1875967130872064:192.168.203.3@tcp:105: 00010000:00010000:0.0:1789061963.412514:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061963.412570:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3066680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120317824:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 10835us (11219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061963.412580:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:3.0:1789061963.414489:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.415644:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120318080 00000100:00100000:2.0:1789061963.415655:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120318080 00000100:00100000:2.0:1789061963.415723:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:2.0:1789061963.415732:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+17:12181:x1875967120318080:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:2.0:1789061963.416006:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:12181:x1875967120318080:12345-192.168.203.3@tcp:35:bash.0 Request processed in 274us (1522us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789061963.416013:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:2.0:1789061963.434011:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130872192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789061963.434081:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061963.434309:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130872192 00000100:00100000:0.0:1789061963.434318:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130872192 00000100:00100000:0.0:1789061963.434374:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789061963.434384:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130872192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789061963.434432:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789061963.434495:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130872192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061963.434503:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789061963.434548:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130872192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789061963.434927:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c3067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130872320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061963.434965:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061963.435147:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130872320 00000100:00100000:3.0:1789061963.435152:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130872320 00000100:00100000:3.0:1789061963.435196:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789061963.435206:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130872320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061963.435227:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789061963.435267:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130872320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061963.435274:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789061963.436177:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c3067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130872320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061963.436436:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061963.436446:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130872448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061963.436495:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061963.436627:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130872448 00000100:00100000:0.0:1789061963.436632:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130872448 00000100:00100000:0.0:1789061963.436670:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789061963.436677:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130872448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789061963.436701:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789061963.436745:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130872448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061963.436751:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789061963.437258:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130872448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061963.558429:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.558524:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120318336 00000100:00100000:2.0:1789061963.558533:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120318336 00000100:00100000:2.0:1789061963.558588:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 157 00000100:00100000:2.0:1789061963.558597:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:12191:x1875967120318336:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061963.558649:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061963.558668:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc71f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba48 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061963.558773:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789061963.558866:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc71f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba48 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.558879:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767f385f100) 00010000:00010000:2.0:1789061963.558882:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061963.558888:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc71f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba48 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.558901:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cf800, rc 0) 00000100:00100000:2.0:1789061963.559096:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:12191:x1875967120318336:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 498us (674us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1789061963.559103:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 157 00000100:00100000:3.0:1789061963.562361:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.562458:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120318592 00000100:00100000:2.0:1789061963.562472:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120318592 00000100:00100000:2.0:1789061963.562536:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:2.0:1789061963.562551:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:12191:x1875967120318592:12345-192.168.203.3@tcp:35:lfs.0 00010000:00010000:0.0:1789061963.562575:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061963.562790:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:12191:x1875967120318592:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 239us (437us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789061963.562798:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:3.0:1789061963.642380:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.642491:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120318720 00000100:00100000:2.0:1789061963.642501:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120318720 00000100:00100000:2.0:1789061963.642564:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 158 00000100:00100000:2.0:1789061963.642588:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:12197:x1875967120318720:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061963.642646:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061963.642666:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7202 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba4f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.642745:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7209 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.642759:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.642770:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061963.642811:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789061963.642815:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061963.642834:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.642859:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7202 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba4f expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.642953:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7209 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba4f expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.642962:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:2.0:1789061963.642965:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061963.642969:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cfa00, rc 0) 00000100:00100000:2.0:1789061963.643029:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:12197:x1875967120318720:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 443us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061963.643044:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 158 00000100:00100000:1.0:1789061963.647375:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.647450:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120318976 00000100:00100000:2.0:1789061963.647460:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120318976 00000100:00100000:2.0:1789061963.647521:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 159 00000100:00100000:2.0:1789061963.647530:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:12197:x1875967120318976:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061963.647550:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061963.647571:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7210 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.647719:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7217 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.647733:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.647745:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061963.647755:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789061963.647856:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7210 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba56 expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.648125:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7217 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba56 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.648136:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767d1235000) 00010000:00010000:2.0:1789061963.648139:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061963.648144:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce600, rc 0) 00000100:00100000:2.0:1789061963.648297:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:12197:x1875967120318976:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 767us (932us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789061963.648305:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 159 00000100:00100000:3.0:1789061963.661182:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061963.661336:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120319104 00000100:00100000:0.0:1789061963.661347:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120319104 00000100:00100000:0.0:1789061963.661418:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:0.0:1789061963.661429:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:2390:x1875967120319104:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061963.661446:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061963.661472:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc7217 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba56 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.661494:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767d1235000) 00010000:00010000:0.0:1789061963.661499:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061963.661553:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:2390:x1875967120319104:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 125us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061963.661579:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1789061963.662373:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061963.662409:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120319360 00000100:00100000:3.0:1789061963.662414:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120319360 00000100:00100000:3.0:1789061963.662451:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 160 00000100:00100000:3.0:1789061963.662459:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:12197:x1875967120319360:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789061963.662481:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061963.662497:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7225 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba5d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061963.662599:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc722c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061963.662644:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc722c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061963.662655:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc722c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061963.662666:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789061963.662776:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7225 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba5d expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061963.662794:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc722c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba5d expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061963.662802:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767d1235000) 00010000:00010000:3.0:1789061963.662805:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789061963.662807:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807a400, rc 0) 00000100:00100000:3.0:1789061963.662849:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:12197:x1875967120319360:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 390us (478us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1789061963.662856:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 160 00000100:00100000:3.0:1789061963.668319:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061963.668471:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120319488 00000100:00100000:1.0:1789061963.668480:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120319488 00000100:00100000:1.0:1789061963.668590:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1789061963.668600:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2392:x1875967120319488:12345-192.168.203.3@tcp:1:lfs.0 00010000:00010000:1.0:1789061963.668681:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.668712:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 6 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.668721:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061963.668739:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061963.668744:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.668778:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 6 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.668792:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 6 pid: 8613 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061963.668807:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8413:1875967130872576:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061963.668886:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6750600 going to sleep for 11 seconds 00000100:00100000:1.0:1789061963.671366:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8413:1875967130872576:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061963.671394:0:8413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061963.674709:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061963.675104:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120319616 00000100:00100000:0.0:1789061963.675114:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120319616 00002000:00100000:0.0:1789061963.675162:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9766c821ea00 x1875967120319616/t0(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:384/0 lens 504/0 e 0 to 0 dl 1789061974 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061963.675173:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c821ea00 with x1875967120319616 ext(0->12) 00010000:00010000:0.0:1789061963.675183:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 7 pid: 8613 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.675203:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 7 pid: 8613 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789061963.675212:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9766c821ea00 00000100:00100000:0.0:1789061963.675248:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:0.0:1789061963.675257:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2393:x1875967120319616:12345-192.168.203.3@tcp:4:lfs.0 00000100:00100000:0.0:1789061963.676863:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2393:x1875967120319616:12345-192.168.203.3@tcp:4:lfs.0 Request processed in 1592us (2148us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789061963.676875:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00002000:00100000:0.0:1789061963.676885:0:8418:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9766c821ea00 x1875967120319616/t4294967306(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:384/0 lens 504/448 e 0 to 0 dl 1789061974 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789061963.676895:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c821ea00 with x1875967120319616 ext(0->12) 00010000:00010000:0.0:1789061963.676904:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 9 pid: 8613 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.676938:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 9 pid: 8613 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789061963.676947:0:8418:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9766c821ea00 00000100:00100000:3.0:1789061963.681201:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.681463:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120319744 00000100:00100000:2.0:1789061963.681474:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120319744 00010000:00010000:2.0:1789061963.681517:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 9 pid: 8613 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061963.681562:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:2.0:1789061963.681572:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2392:x1875967120319744:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061963.681599:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789061963.681654:0:6480:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789061963.681657:0:6480:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789061962 00002000:00010000:2.0:1789061963.681660:0:6480:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789061962 00002000:00010000:2.0:1789061963.681662:0:6480:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789061962 00002000:00010000:2.0:1789061963.681665:0:6480:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789061963.681671:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 9 pid: 8613 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.681696:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 9 pid: 8613 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.681719:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a139ac71/0x2774d8f311dc71ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba41 expref: 9 pid: 8613 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.681736:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061963.681741:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061963.681761:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.681771:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.681796:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061963.682001:0:8413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.682022:0:8413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.682043:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.682052:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.682077:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.682084:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ac00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789061963.682088:0:8413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.682098:0:8413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.682112:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061963.682120:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e5fa45c/0x2774d8f311dc723a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061963.682165:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120319488:12345-192.168.203.3@tcp:1:lfs.0 Request processed in 13566us (13854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061963.682173:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:2.0:1789061963.682571:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120319744:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 280us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061963.682584:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:3.0:1789061963.686512:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.686600:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120320000 00000100:00100000:2.0:1789061963.686661:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120320000 00000100:00100000:2.0:1789061963.686732:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:2.0:1789061963.686742:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f06850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:12197:x1875967120320000:12345-192.168.203.3@tcp:35:lfs.0 00000004:00010000:2.0:1789061963.686807:0:6500:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc722c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba5d expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789061963.687294:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1789061963.687329:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789061963.688848:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1789061963.688995:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.689213:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc71d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba33 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.689224:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.689280:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc71d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba33 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.689297:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc71d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba33 expref: 28 pid: 8435 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061963.689311:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6500:1875967130872704:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061963.689464:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061963.707696:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6500:1875967130872704:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061963.707728:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061963.709105:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061963.709237:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120320128 00000100:00100000:0.0:1789061963.709247:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120320128 00010000:00010000:0.0:1789061963.709285:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc71d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba33 expref: 29 pid: 8435 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061963.709327:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:0.0:1789061963.709336:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:2393:x1875967120320128:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061963.709350:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061963.709356:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc71d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba33 expref: 29 pid: 8435 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.709368:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc71d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba33 expref: 29 pid: 8435 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.709389:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc71d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba33 expref: 29 pid: 8435 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.709406:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767d1235000) 00010000:00010000:0.0:1789061963.709412:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.709421:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.709441:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.709472:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061963.709520:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+28:2393:x1875967120320128:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 185us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061963.709529:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 82 00010000:00010000:2.0:1789061963.709602:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.709646:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789061963.709752:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1789061963.709866:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1789061963.709948:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1875967130872832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789061963.709990:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061963.710017:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727900 going to sleep for 11 seconds 00000100:00100000:3.0:1789061963.710501:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130872832 00000100:00100000:3.0:1789061963.710517:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130872832 00000100:00080000:0.0:1789061963.710570:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061963.710664:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789061963.710677:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6500:x1875967130872832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789061963.710785:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6500:x1875967130872832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061963.710819:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1875967130872832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789061963.710936:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1789061963.710978:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1875967130872960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789061963.711029:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061963.711054:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c77273c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061963.711278:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130872960 00000100:00100000:0.0:1789061963.711283:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130872960 00000100:00100000:3.0:1789061963.713747:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789061963.717716:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789061963.717740:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6500:x1875967130872960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789061963.717957:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6500:x1875967130872960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 228us (6927us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789061963.717966:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789061963.718036:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1875967130872960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789061963.718108:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1789061963.718155:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061963.718166:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061963.718174:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061963.718180:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061963.718185:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061963.718193:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061963.718207:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767d1235000) 00010000:00010000:3.0:1789061963.718210:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789061963.718215:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061963.718221:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7241 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789061963.718338:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789061963.718395:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1789061963.718405:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344827798177ns, next at 345827796371ns, rc = 0 00000001:00080000:3.0:1789061963.718411:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1789061963.718436:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767d1235000) 00010000:00010000:3.0:1789061963.718439:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789061963.718446:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc722c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba5d expref: 32 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061963.720199:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f06850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+31:12197:x1875967120320000:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 33451us (33687us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789061963.720210:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00000020:00080000:3.0:1789061963.720216:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789061963.724243:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061963.724321:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120320256 00000100:00100000:0.0:1789061963.724331:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120320256 00000100:00100000:0.0:1789061963.724395:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 161 00000100:00100000:0.0:1789061963.724406:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+31:12197:x1875967120320256:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061963.724429:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061963.724451:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7248 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba64 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.724507:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7248 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba64 expref: 32 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.724523:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7248 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba64 expref: 32 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.724557:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:0.0:1789061963.724561:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789061963.724565:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198600, rc 0) 00000100:00100000:0.0:1789061963.724660:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:12197:x1875967120320256:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 254us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061963.724668:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 161 00000100:00100000:1.0:1789061963.730378:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061963.730450:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120320512 00000100:00100000:3.0:1789061963.730460:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120320512 00000100:00100000:3.0:1789061963.730521:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:3.0:1789061963.730533:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:12197:x1875967120320512:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1789061963.730989:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+33:12197:x1875967120320512:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 457us (618us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789061963.730997:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:3.0:1789061963.839845:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.840773:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120320768 00000100:00100000:2.0:1789061963.840785:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120320768 00000100:00100000:2.0:1789061963.840849:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 162 00000100:00100000:2.0:1789061963.840859:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+33:12207:x1875967120320768:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061963.840884:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061963.840914:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc724f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061963.841023:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789061963.841538:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc724f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba6b expref: 35 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.841551:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767f385f100) 00010000:00010000:2.0:1789061963.841553:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061963.841558:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc724f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba6b expref: 35 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.841572:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cf800, rc 0) 00000100:00100000:2.0:1789061963.841918:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+34:12207:x1875967120320768:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1059us (2083us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1789061963.841926:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 162 00000100:00100000:3.0:1789061963.845260:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.845365:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120320896 00000100:00100000:2.0:1789061963.845387:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120320896 00000100:00100000:0.0:1789061963.845671:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 163 00000100:00100000:0.0:1789061963.845694:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+34:12207:x1875967120320896:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:0.0:1789061963.845774:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc725d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.845792:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc725d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.845804:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc725d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.845815:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc7264 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.845822:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc7264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.845828:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc7264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.850841:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc726b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.850899:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc726b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.850911:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc726b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061963.850971:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc726b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.850984:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc725d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.850991:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc725d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.850997:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc725d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851004:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061963.851008:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc725d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851016:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc725d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851028:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:0.0:1789061963.851031:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061963.851035:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc725d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851041:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc725d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851072:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc7264 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851079:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc7264 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851085:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc7264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851091:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061963.851093:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc7264 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851099:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc7264 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851107:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767d1235200) 00010000:00010000:0.0:1789061963.851109:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061963.851112:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc7264 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851118:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc7264 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851126:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc726b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851132:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc726b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851137:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc726b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851148:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061963.851152:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc726b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851158:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc726b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851166:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:0.0:1789061963.851168:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061963.851171:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc726b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061963.851176:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc726b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061963.851273:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+34:12207:x1875967120320896:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 5588us (6016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061963.851283:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 163 00000100:00100000:1.0:1789061963.863931:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.864090:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120321152 00000100:00100000:2.0:1789061963.864100:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120321152 00000100:00100000:2.0:1789061963.864159:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:2.0:1789061963.864170:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+34:12207:x1875967120321152:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1789061963.864396:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+35:12207:x1875967120321152:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 227us (474us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789061963.864403:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:3.0:1789061963.926263:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.927080:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120321408 00000100:00100000:2.0:1789061963.927092:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120321408 00000100:00100000:2.0:1789061963.927209:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 164 00000100:00100000:2.0:1789061963.927220:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+35:12210:x1875967120321408:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061963.927247:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061963.927268:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7272 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba72 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927341:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7279 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927357:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7279 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927369:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7279 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927380:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7280 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927388:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927412:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927516:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7287 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927524:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927532:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7287 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061963.927541:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789061963.927673:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7279 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927692:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7279 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927699:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7279 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927705:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cee00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061963.927710:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7279 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927717:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7279 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927728:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:2.0:1789061963.927731:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061963.927743:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7279 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927749:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7279 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927766:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7280 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927777:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7280 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927784:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7280 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927788:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061963.927792:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7280 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927797:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7280 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927805:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767d1235200) 00010000:00010000:2.0:1789061963.927807:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061963.927810:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7280 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927816:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7280 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927855:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7272 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba72 expref: 38 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927881:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7287 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba72 expref: 37 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.927900:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061963.927902:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061963.927905:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce400, rc 0) 00000100:00100000:2.0:1789061963.927976:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+37:12210:x1875967120321408:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 757us (1722us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789061963.927984:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 164 00000100:00100000:3.0:1789061963.939529:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.939733:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120321536 00000100:00100000:2.0:1789061963.939743:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120321536 00000100:00100000:2.0:1789061963.939809:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 165 00000100:00100000:2.0:1789061963.939819:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+37:12210:x1875967120321536:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:2.0:1789061963.939880:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7295 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.939896:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.939907:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.939939:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.939946:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7295 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.939969:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.939975:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061963.939979:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.939987:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7295 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.939998:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061963.940001:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061963.940005:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7295 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061963.940011:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc7295 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061963.940080:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+37:12210:x1875967120321536:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 263us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061963.940088:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 165 00000100:00100000:1.0:1789061963.944918:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061963.944986:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120321792 00000100:00100000:2.0:1789061963.944995:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120321792 00000100:00100000:2.0:1789061963.945054:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:2.0:1789061963.945064:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+37:12210:x1875967120321792:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1789061963.945289:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:12210:x1875967120321792:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 226us (378us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789061963.945296:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:3.0:1789061964.343224:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061964.343731:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120322048 00000100:00100000:0.0:1789061964.343743:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120322048 00000100:00100000:0.0:1789061964.343805:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 166 00000100:00100000:0.0:1789061964.343816:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:12241:x1875967120322048:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:0.0:1789061964.344083:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061964.344105:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc729c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba79 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.344208:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc72a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.344238:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc72a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.344250:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc72a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061964.344261:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789061964.344353:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc729c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba79 expref: 41 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.344371:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc72a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba79 expref: 40 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.344380:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:0.0:1789061964.344383:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061964.344386:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198a00, rc 0) 00000100:00100000:0.0:1789061964.344491:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+40:12241:x1875967120322048:12345-192.168.203.3@tcp:101:cat.0 Request processed in 677us (1276us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789061964.344499:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 166 00000100:00100000:0.0:1789061964.350662:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061964.350790:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120322304 00000100:00100000:2.0:1789061964.350799:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120322304 00000100:00100000:2.0:1789061964.350856:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:2.0:1789061964.350865:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+40:12241:x1875967120322304:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:2.0:1789061964.351081:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+41:12241:x1875967120322304:12345-192.168.203.3@tcp:35:cat.0 Request processed in 217us (427us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789061964.351089:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:3.0:1789061964.351781:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061964.352129:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120322432 00000100:00100000:0.0:1789061964.352134:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120322432 00000100:00100000:0.0:1789061964.352178:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1789061964.352185:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+41:2390:x1875967120322432:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061964.352196:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061964.352219:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc72a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba79 expref: 41 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.352251:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:0.0:1789061964.352255:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061964.352279:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+40:2390:x1875967120322432:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 96us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061964.352286:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1789061964.433447:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061964.433560:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120322688 00000100:00100000:2.0:1789061964.433570:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120322688 00000100:00100000:2.0:1789061964.433672:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 167 00000100:00100000:2.0:1789061964.433692:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+40:12247:x1875967120322688:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1789061964.433716:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061964.433720:0:10077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789061964.433745:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7209 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba4f expref: 40 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.433766:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:2.0:1789061964.433770:0:10077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061964.433781:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72b1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba80 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.433877:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.433891:0:10077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7287 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba72 expref: 40 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.433899:0:10077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.433943:0:10077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7287 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba72 expref: 40 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.433956:0:10077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7287 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba72 expref: 40 pid: 10077 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061964.433969:0:10077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130873088:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061964.434069:0:10077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d82d7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789061964.437761:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061964.437789:0:10077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130873088:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061964.437819:0:10077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061964.439205:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120322816 00000100:00100000:0.0:1789061964.439214:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120322816 00010000:00010000:0.0:1789061964.439265:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7287 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba72 expref: 41 pid: 10077 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061964.439296:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 83 00000100:00100000:0.0:1789061964.439304:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767d64e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+41:2392:x1875967120322816:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061964.439317:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061964.439323:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7287 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba72 expref: 41 pid: 10077 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.439337:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7287 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba72 expref: 41 pid: 10077 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.439356:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7287 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba72 expref: 41 pid: 10077 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.439373:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:0.0:1789061964.439377:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.439399:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.439407:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.439439:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061964.439496:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767d64e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+40:2392:x1875967120322816:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 192us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061964.439503:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 83 00010000:00010000:2.0:1789061964.439600:0:10077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.439634:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061964.439654:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789061964.439788:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba80 expref: 41 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.439804:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba80 expref: 40 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.439811:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061964.439813:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789061964.439822:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cf200, rc 0) 00000100:00100000:2.0:1789061964.439855:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+40:12247:x1875967120322688:12345-192.168.203.3@tcp:101:dd.0 Request processed in 6174us (6417us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789061964.439862:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 167 00000100:00100000:1.0:1789061964.443504:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061964.443586:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120322944 00000100:00100000:0.0:1789061964.443596:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120322944 00000100:00100000:0.0:1789061964.443672:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 168 00000100:00100000:0.0:1789061964.443691:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+40:12247:x1875967120322944:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:0.0:1789061964.443714:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061964.443734:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc72c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba87 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.443763:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc72cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.443776:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc72cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.443786:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc72cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.443892:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc72c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba87 expref: 42 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.443921:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc72cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba87 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.443931:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:0.0:1789061964.443934:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789061964.443937:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198c00, rc 0) 00000100:00100000:0.0:1789061964.443997:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+41:12247:x1875967120322944:12345-192.168.203.3@tcp:101:dd.0 Request processed in 316us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061964.444004:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 168 00000100:00100000:0.0:1789061964.449052:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061964.449513:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120323200 00000100:00100000:2.0:1789061964.449523:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120323200 00000100:00100000:2.0:1789061964.449575:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 169 00000100:00100000:2.0:1789061964.449585:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+41:12247:x1875967120323200:12345-192.168.203.3@tcp:36:dd.0 00010000:00010000:2.0:1789061964.449857:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.449874:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.449885:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789061964.449927:0:8435:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1789061964.449951:0:8435:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c051e590 reply state 000000009ef28f19 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.449964:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.449972:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061964.449975:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789061964.449979:0:8435:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061964.450061:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+44:12247:x1875967120323200:12345-192.168.203.3@tcp:36:dd.0 Request processed in 477us (1018us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789061964.450069:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 169 00000020:00080000:2.0:1789061964.450087:0:8435:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789061964.585922:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061964.818340:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061964.819196:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120323328 00000100:00100000:2.0:1789061964.819206:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120323328 00000100:00100000:2.0:1789061964.819280:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 170 00000100:00100000:2.0:1789061964.819289:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+44:12261:x1875967120323328:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:2.0:1789061964.819312:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061964.819333:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc72db lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba8e expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.819396:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc72e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.819410:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc72e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.819422:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc72e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.819433:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc72e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.819441:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc72e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.819447:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc72e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.819511:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc72f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.819522:0:10077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba80 expref: 45 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.819543:0:10077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc72f0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.819575:0:10077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba80 expref: 45 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061964.819588:0:10077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba80 expref: 45 pid: 10077 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061964.819602:0:10077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130873216:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061964.819752:0:10077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d82d7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789061964.825653:0:10077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130873216:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061964.825694:0:10077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc72f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061964.828107:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061964.828509:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120323584 00000100:00100000:2.0:1789061964.828518:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120323584 00000100:00100000:2.0:1789061964.828579:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:2.0:1789061964.828588:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+46:6162:x1875967120323584:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789061964.828889:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+47:6162:x1875967120323584:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 301us (789us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789061964.828896:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:1.0:1789061964.831342:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061964.831495:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120323712 00000100:00100000:0.0:1789061964.831504:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120323712 00010000:00010000:0.0:1789061964.831541:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba80 expref: 47 pid: 10077 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061964.831588:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00100000:0.0:1789061964.831597:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+47:2393:x1875967120323712:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061964.831636:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061964.831643:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba80 expref: 47 pid: 10077 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.831655:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba80 expref: 47 pid: 10077 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.831686:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc72b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba80 expref: 47 pid: 10077 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.831727:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:0.0:1789061964.831733:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc72f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.831741:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc72f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.831748:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc72f0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061964.831783:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061964.831832:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+46:2393:x1875967120323712:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 236us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061964.831840:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 84 00010000:00010000:1.0:1789061964.832198:0:10077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc72f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832207:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc72f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061964.832273:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789061964.832278:0:10077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061964.832301:0:10077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc72f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832313:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc72f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832322:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc72e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832328:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc72e2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832335:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc72e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832341:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cee00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061964.832345:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc72e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832352:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc72e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832362:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:1.0:1789061964.832365:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061964.832369:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc72e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832383:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc72e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832396:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc72e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832402:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc72e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832407:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc72e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832412:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061964.832415:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc72e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832421:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc72e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832429:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767d1235200) 00010000:00010000:1.0:1789061964.832432:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061964.832435:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc72e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832440:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc72e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832468:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc72db lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba8e expref: 46 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832494:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc72f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba8e expref: 45 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.832501:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:1.0:1789061964.832503:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061964.832506:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce400, rc 0) 00000100:00100000:1.0:1789061964.832535:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+45:12261:x1875967120323328:12345-192.168.203.3@tcp:101:stat.0 Request processed in 13247us (14204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061964.832541:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 170 00000100:00100000:3.0:1789061964.899000:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061964.899458:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120323968 00000100:00100000:1.0:1789061964.899468:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120323968 00000100:00100000:1.0:1789061964.899525:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 171 00000100:00100000:1.0:1789061964.899536:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+45:12267:x1875967120323968:12345-192.168.203.3@tcp:36:truncate.0 00010000:00010000:1.0:1789061964.899590:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061964.899645:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc72f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba8e expref: 45 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.899665:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:1.0:1789061964.899670:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061964.899858:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc72f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.899874:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc72f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.899884:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc72f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789061964.899941:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1789061964.899965:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000233a1c0c reply state 000000006e9837d0 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc72f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.899977:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc72f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061964.899985:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:1.0:1789061964.899988:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789061964.899991:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789061964.900333:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+47:12267:x1875967120323968:12345-192.168.203.3@tcp:36:truncate.0 Request processed in 798us (1341us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789061964.900340:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 171 00000020:00080000:1.0:1789061964.900345:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789061965.058338:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061965.058439:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120324096 00000100:00100000:0.0:1789061965.058449:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120324096 00000100:00100000:0.0:1789061965.058529:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00100000:0.0:1789061965.058540:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+47:12281:x1875967120324096:12345-192.168.203.3@tcp:101:stat.0 00010000:00010000:0.0:1789061965.058565:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061965.058591:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc72fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba95 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058731:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7305 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058746:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7305 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058757:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7305 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058778:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc730c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058786:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc730c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058793:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc730c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058863:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058872:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058879:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061965.058915:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789061965.058920:0:8435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789061965.058952:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058964:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058973:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7305 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058979:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7305 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.058996:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7305 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059002:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061965.059006:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7305 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059013:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7305 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059025:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:0.0:1789061965.059028:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061965.059032:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7305 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059038:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc7305 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059051:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc730c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059057:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc730c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059064:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc730c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059069:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061965.059072:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc730c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059087:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc730c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059096:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767d1235200) 00010000:00010000:0.0:1789061965.059098:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061965.059101:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc730c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059107:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc730c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059135:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc72fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba95 expref: 49 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059149:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba95 expref: 48 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.059156:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:0.0:1789061965.059158:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061965.059160:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199600, rc 0) 00000100:00100000:0.0:1789061965.059214:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+48:12281:x1875967120324096:12345-192.168.203.3@tcp:101:stat.0 Request processed in 675us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061965.059222:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 172 00000100:00080000:1.0:1789061965.059402:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061965.145424:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061965.145584:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120324352 00000100:00100000:1.0:1789061965.145594:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120324352 00000100:00100000:1.0:1789061965.145708:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 173 00000100:00100000:1.0:1789061965.145719:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+48:12291:x1875967120324352:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061965.145743:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061965.145764:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc731a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3ba9c expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061965.145860:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789061965.145953:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc731a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba9c expref: 50 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061965.145968:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767f385f100) 00010000:00010000:1.0:1789061965.145983:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789061965.145989:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc731a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba9c expref: 50 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061965.146003:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47be00, rc 0) 00000100:00100000:1.0:1789061965.146063:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+49:12291:x1875967120324352:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 345us (647us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1789061965.146070:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 173 00000100:00100000:3.0:1789061965.153323:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061965.153468:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120324608 00000100:00100000:2.0:1789061965.153478:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120324608 00000100:00100000:2.0:1789061965.153546:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:2.0:1789061965.153556:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f05850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+49:12291:x1875967120324608:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1789061965.153815:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f05850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+50:12291:x1875967120324608:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 260us (499us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1789061965.153823:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:3.0:1789061965.260105:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061965.260247:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120324864 00000100:00100000:2.0:1789061965.260256:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120324864 00000100:00100000:2.0:1789061965.260324:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 174 00000100:00100000:2.0:1789061965.260335:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+50:12297:x1875967120324864:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1789061965.260359:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061965.260381:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7328 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3baa3 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.260476:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.260491:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba95 expref: 51 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.260501:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.260533:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba95 expref: 51 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.260546:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba95 expref: 51 pid: 8435 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061965.260589:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1875967130873344:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061965.260725:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d82d7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789061965.268043:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061965.268238:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120324992 00000100:00100000:0.0:1789061965.268247:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120324992 00010000:00010000:0.0:1789061965.268285:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba95 expref: 52 pid: 8435 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061965.268343:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 85 00000100:00100000:0.0:1789061965.268353:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+52:2392:x1875967120324992:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061965.268377:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061965.268384:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba95 expref: 52 pid: 8435 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.268396:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba95 expref: 52 pid: 8435 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.268417:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:0.0:1789061965.268421:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.268430:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.268438:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.268458:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061965.268509:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+52:2392:x1875967120324992:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 158us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061965.268516:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 85 00010000:00010000:2.0:1789061965.269091:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc7313 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba95 expref: 51 pid: 8435 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061965.269108:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1875967130873344:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061965.269128:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.269136:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.269142:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061965.269158:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789061965.269262:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7328 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baa3 expref: 52 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.269277:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baa3 expref: 51 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.269284:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061965.269287:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789061965.269289:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce600, rc 0) 00000100:00100000:2.0:1789061965.269329:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+51:12297:x1875967120324864:12345-192.168.203.3@tcp:101:bash.0 Request processed in 8997us (9234us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789061965.269346:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 174 00000100:00100000:1.0:1789061965.274535:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061965.274723:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120325248 00000100:00100000:3.0:1789061965.274732:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120325248 00000100:00100000:3.0:1789061965.274789:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 175 00000100:00100000:3.0:1789061965.274798:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+51:12297:x1875967120325248:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:3.0:1789061965.275881:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc733d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.275901:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc733d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.275913:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc733d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061965.275975:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1789061965.275995:0:6496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035ee93e1 reply state 0000000092721104 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc733d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.276007:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc733d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.276015:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:3.0:1789061965.276018:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789061965.276021:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061965.276123:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:12297:x1875967120325248:12345-192.168.203.3@tcp:36:bash.0 Request processed in 1325us (1595us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789061965.276131:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 175 00000020:00080000:3.0:1789061965.276136:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789061965.285649:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061965.285748:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120325376 00000100:00100000:2.0:1789061965.285759:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120325376 00000100:00100000:2.0:1789061965.285819:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 176 00000100:00100000:2.0:1789061965.285829:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:12297:x1875967120325376:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1789061965.285853:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061965.285873:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7344 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3baaa expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.285973:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc734b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.285987:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baa3 expref: 55 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.285999:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc734b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.286030:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baa3 expref: 55 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.286043:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baa3 expref: 55 pid: 6498 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061965.286056:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130873472:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061965.286137:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d82d7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061965.291411:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130873472:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061965.291454:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc734b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061965.294640:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061965.294729:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120325504 00000100:00100000:3.0:1789061965.294739:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120325504 00010000:00010000:3.0:1789061965.294777:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baa3 expref: 56 pid: 6498 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061965.294818:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 86 00000100:00100000:3.0:1789061965.294827:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7562d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+56:2393:x1875967120325504:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061965.294840:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061965.294847:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baa3 expref: 56 pid: 6498 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.294858:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baa3 expref: 56 pid: 6498 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.294878:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce600/0x2774d8f311dc732f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baa3 expref: 56 pid: 6498 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.294895:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:3.0:1789061965.294899:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc734b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.294909:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc734b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.294917:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc734b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.294951:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061965.295003:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7562d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+55:2393:x1875967120325504:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 177us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061965.295025:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 86 00010000:00010000:1.0:1789061965.295538:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc734b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061965.295547:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc734b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061965.295636:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789061965.295640:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061965.295661:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc734b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061965.295699:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7344 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baaa expref: 55 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061965.295715:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc734b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baaa expref: 54 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061965.295722:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:1.0:1789061965.295724:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061965.295734:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce400, rc 0) 00000100:00100000:1.0:1789061965.295771:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:12297:x1875967120325376:12345-192.168.203.3@tcp:101:bash.0 Request processed in 9945us (10131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061965.295778:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 176 00000100:00100000:0.0:1789061965.309043:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061965.309192:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120325760 00000100:00100000:2.0:1789061965.309208:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120325760 00000100:00100000:2.0:1789061965.309274:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:2.0:1789061965.309285:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+54:12297:x1875967120325760:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:2.0:1789061965.309589:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+55:12297:x1875967120325760:12345-192.168.203.3@tcp:35:bash.0 Request processed in 306us (554us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789061965.309597:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:3.0:1789061965.405552:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061965.405732:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120326016 00000100:00100000:2.0:1789061965.405743:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120326016 00000100:00100000:2.0:1789061965.405813:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 177 00000100:00100000:2.0:1789061965.405824:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+55:12307:x1875967120326016:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061965.405859:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061965.405880:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bab1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061965.405974:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789061965.406065:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7352 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bab1 expref: 57 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.406079:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767f385f100) 00010000:00010000:2.0:1789061965.406082:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061965.406087:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bab1 expref: 57 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.406121:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce800, rc 0) 00000100:00100000:2.0:1789061965.406182:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+56:12307:x1875967120326016:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 360us (639us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1789061965.406202:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 177 00000100:00100000:1.0:1789061965.410510:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061965.410601:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120326144 00000100:00100000:3.0:1789061965.410644:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120326144 00000100:00100000:3.0:1789061965.410707:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 178 00000100:00100000:3.0:1789061965.410718:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+56:12307:x1875967120326144:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:3.0:1789061965.410787:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7360 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.410819:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7360 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.410832:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7360 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.410843:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7367 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.410851:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.410857:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.410928:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc736e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.410938:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc736e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.410945:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc736e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061965.411005:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc736e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411018:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7360 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411023:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7360 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411030:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7360 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411036:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061965.411040:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7360 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411047:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7360 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411216:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:3.0:1789061965.411220:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061965.411225:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7360 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411231:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7360 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411245:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7367 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411250:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7367 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411263:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7367 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411268:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061965.411272:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7367 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411278:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7367 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411287:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767d1235200) 00010000:00010000:3.0:1789061965.411290:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061965.411293:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7367 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411299:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7367 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411311:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc736e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411317:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc736e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411322:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc736e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411327:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807aa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061965.411329:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc736e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411345:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc736e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411352:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:3.0:1789061965.411354:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061965.411357:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc736e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.411362:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc736e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061965.411481:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+56:12307:x1875967120326144:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 764us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061965.411489:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 178 00000100:00100000:0.0:1789061965.415352:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061965.415500:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120326400 00000100:00100000:2.0:1789061965.415511:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120326400 00000100:00100000:2.0:1789061965.415576:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:2.0:1789061965.415586:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+56:12307:x1875967120326400:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1789061965.415969:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+57:12307:x1875967120326400:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 384us (626us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789061965.415978:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:1.0:1789061965.463469:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061965.463562:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120326656 00000100:00100000:2.0:1789061965.463572:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120326656 00000100:00100000:2.0:1789061965.463665:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 179 00000100:00100000:2.0:1789061965.463686:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+57:12310:x1875967120326656:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061965.463710:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061965.463731:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7375 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bab8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.463830:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc737c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.463844:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc737c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.463855:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc737c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.463874:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7383 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.463967:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.463976:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464090:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc738a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464099:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc738a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464106:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc738a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061965.464115:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789061965.464461:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc737c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464469:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc737c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464475:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc737c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464480:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061965.464484:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc737c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464503:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc737c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464515:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:2.0:1789061965.464519:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061965.464524:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc737c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464530:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc737c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464543:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464548:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7383 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464554:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464559:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cfa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061965.464562:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464568:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7383 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464575:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767d1235200) 00010000:00010000:2.0:1789061965.464578:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061965.464581:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7383 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464597:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc7383 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464741:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc7375 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bab8 expref: 60 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464755:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc738a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bab8 expref: 59 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.464763:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061965.464765:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061965.464767:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce000, rc 0) 00000100:00100000:2.0:1789061965.464830:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:12310:x1875967120326656:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1156us (1370us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789061965.464838:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 179 00000100:00100000:1.0:1789061965.469852:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061965.469935:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120326784 00000100:00100000:2.0:1789061965.469944:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120326784 00000100:00100000:2.0:1789061965.470006:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:2.0:1789061965.470016:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:12310:x1875967120326784:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:2.0:1789061965.470090:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7398 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.470107:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.470118:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.470180:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.470187:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7398 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.470194:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.470200:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cee00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061965.470204:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.470211:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7398 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.470222:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061965.470225:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789061965.470229:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7398 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.470235:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc7398 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061965.470311:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:12310:x1875967120326784:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 295us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061965.470317:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 180 00000100:00100000:0.0:1789061965.473818:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061965.473903:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120327040 00000100:00100000:2.0:1789061965.473912:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120327040 00000100:00100000:2.0:1789061965.473962:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:2.0:1789061965.473992:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:12310:x1875967120327040:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1789061965.474351:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:12310:x1875967120327040:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 359us (539us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789061965.474359:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:1.0:1789061965.481711:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061965.481798:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120327168 00000100:00100000:0.0:1789061965.481807:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120327168 00000100:00100000:0.0:1789061965.481867:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1789061965.481885:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:2392:x1875967120327168:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061965.481901:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061965.481925:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc738a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bab8 expref: 60 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061965.481946:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:0.0:1789061965.481950:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061965.482010:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:2392:x1875967120327168:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 134us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061965.482017:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00010000:00010000:2.0:1789061965.609903:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061965.613495:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061965.613662:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120327424 00000100:00100000:3.0:1789061965.613684:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120327424 00000100:00100000:3.0:1789061965.613829:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:3.0:1789061965.613844:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:12329:x1875967120327424:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:3.0:1789061965.613876:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061965.613907:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc739f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3babf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.614063:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc73a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.614081:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc73a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.614094:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc73a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061965.614126:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789061965.614269:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc739f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3babf expref: 62 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.614296:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc73a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3babf expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.614306:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:3.0:1789061965.614309:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789061965.614313:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807b600, rc 0) 00000100:00100000:3.0:1789061965.614508:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:12329:x1875967120327424:12345-192.168.203.3@tcp:101:cat.0 Request processed in 669us (1025us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789061965.614515:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 181 00000100:00100000:3.0:1789061965.639340:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061965.640117:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120327552 00000100:00100000:2.0:1789061965.640133:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120327552 00000100:00100000:2.0:1789061965.640229:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:2.0:1789061965.640252:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:12330:x1875967120327552:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789061965.640283:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061965.640310:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc73b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bac6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.640395:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc73bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.640411:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc73bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.640425:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc73bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061965.640479:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789061965.640483:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061965.640506:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc73bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.640536:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc73b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bac6 expref: 63 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.640586:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc73bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bac6 expref: 62 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.640595:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:2.0:1789061965.640599:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061965.640677:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce800, rc 0) 00000100:00100000:2.0:1789061965.640767:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:12330:x1875967120327552:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 527us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061965.640786:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 182 00000100:00100000:1.0:1789061965.644104:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061965.644264:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120327936 00000100:00100000:3.0:1789061965.644277:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120327936 00000100:00100000:3.0:1789061965.644350:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:3.0:1789061965.644362:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:12330:x1875967120327936:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1789061965.645308:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+63:12330:x1875967120327936:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 942us (1213us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789061965.645318:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:1.0:1789061965.653637:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061965.653746:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120328064 00000100:00100000:3.0:1789061965.653760:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120328064 00000100:00100000:3.0:1789061965.653893:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:3.0:1789061965.653905:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+63:12330:x1875967120328064:12345-192.168.203.3@tcp:103:lfs.0 00010000:00010000:3.0:1789061965.653955:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789061965.653988:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc734b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baaa expref: 63 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.654017:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc73a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3babf expref: 62 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.654031:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7248 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba64 expref: 61 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.654043:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:3.0:1789061965.654059:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061965.654137:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:12330:x1875967120328064:12345-192.168.203.3@tcp:103:lfs.0 Request processed in 230us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061965.654146:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:0.0:1789061965.656234:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061965.656344:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120328192 00000100:00100000:2.0:1789061965.656356:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120328192 00000100:00100000:2.0:1789061965.656423:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:2.0:1789061965.656434:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:12330:x1875967120328192:12345-192.168.203.3@tcp:58:lfs.0 00010000:00010000:2.0:1789061965.656598:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc73c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.656645:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc73c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061965.656659:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc73c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789061965.657037:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789061965.657207:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:12330:x1875967120328192:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 772us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061965.657217:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 183 00000100:00100000:1.0:1789061965.673806:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061965.673839:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120328320 00000100:00100000:3.0:1789061965.673853:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120328320 00000100:00100000:3.0:1789061965.673920:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:3.0:1789061965.673932:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:12332:x1875967120328320:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789061965.673961:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061965.673991:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc73c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bacd expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674180:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc73d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674199:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc73d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674221:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc73d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674234:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc73d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674241:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc73d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674246:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc73d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674387:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674397:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674403:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061965.674455:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789061965.674460:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789061965.674483:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674496:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674505:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc73d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674523:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc73d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674530:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc73d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674537:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807aa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061965.674542:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc73d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.674550:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc73d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.675023:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:3.0:1789061965.675028:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061965.675035:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc73d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.675042:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc73d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.675317:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc73d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.675324:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc73d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.675331:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc73d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.675337:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061965.675351:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc73d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.675359:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc73d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.675370:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767d1235200) 00010000:00010000:3.0:1789061965.675373:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061965.675377:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc73d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.675383:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc73d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.675427:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc73c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bacd expref: 62 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.675443:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bacd expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061965.675450:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:3.0:1789061965.675453:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789061965.675456:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807be00, rc 0) 00000100:00100000:2.0:1789061965.675867:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:12332:x1875967120328320:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1933us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061965.675884:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 184 00000100:00100000:0.0:1789061965.994985:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061965.995017:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130873600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789061965.995111:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061965.995236:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130873600 00000100:00100000:2.0:1789061965.995246:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130873600 00000100:00100000:2.0:1789061965.995310:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789061965.995322:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130873600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789061965.995365:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789061965.995428:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130873600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061965.995436:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789061965.996093:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130873600:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789061966.382060:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061966.382076:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061966.382112:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789061966.382132:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061966.382315:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8173800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13772:1875967130873728:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789061966.382435:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061966.389147:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8173800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13772:1875967130873728:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789061966.393421:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061966.393800:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120328448 00000100:00100000:0.0:1789061966.393813:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120328448 00000100:00100000:0.0:1789061966.393892:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 185 00000100:00100000:0.0:1789061966.393903:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:12343:x1875967120328448:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789061966.393942:0:6497:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789061966.394083:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:12343:x1875967120328448:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 182us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061966.394091:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 185 00000100:00100000:3.0:1789061966.401938:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061966.402020:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120328576 00000100:00100000:2.0:1789061966.402033:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120328576 00000100:00100000:2.0:1789061966.402107:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 186 00000100:00100000:2.0:1789061966.402128:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c821c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:12343:x1875967120328576:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789061966.402233:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc73e5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402255:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc73e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402270:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc73e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402288:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc73ec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402296:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc73ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402310:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc73ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402346:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc73f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402355:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc73f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402363:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc73f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061966.402433:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789061966.402439:0:8435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061966.402455:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc73f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402468:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc73e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402474:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc73e5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402481:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc73e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402500:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061966.402505:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc73e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402514:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc73e5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402534:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c7417500) 00010000:00010000:2.0:1789061966.402538:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061966.402544:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc73e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402552:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc73e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402567:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc73ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402574:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc73ec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402581:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc73ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402587:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cfa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061966.402590:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc73ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402596:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc73ec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402945:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9767d1235d00) 00010000:00010000:2.0:1789061966.402950:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061966.402955:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc73ec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402961:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc73ec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402991:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc73f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.402998:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc73f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.403005:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc73f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.403011:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061966.403015:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc73f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.403022:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc73f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.403030:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061966.403033:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061966.403037:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc73f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.403044:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc73f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061966.403328:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c821c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:12343:x1875967120328576:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 1207us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061966.403337:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 186 00000100:00100000:2.0:1789061966.410910:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061966.414686:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120328832 00000100:00100000:0.0:1789061966.414715:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120328832 00000100:00100000:0.0:1789061966.414812:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 187 00000100:00100000:0.0:1789061966.414826:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:12343:x1875967120328832:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061966.414856:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061966.414883:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc73fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bad4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.415374:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7401 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.415393:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.415406:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061966.415417:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789061966.415521:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.415530:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7401 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.415536:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7401 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.415543:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061966.415548:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7401 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.415557:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7401 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.415662:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:0.0:1789061966.415675:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061966.415682:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7401 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.415690:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7401 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.415741:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc73fa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bad4 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.415754:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c7417500) 00010000:00010000:0.0:1789061966.415757:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789061966.415762:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc73fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bad4 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.415916:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198200, rc 0) 00000100:00100000:0.0:1789061966.416250:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:12343:x1875967120328832:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1425us (5352us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1789061966.416260:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 187 00000100:00100000:0.0:1789061966.421454:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061966.421586:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120328960 00000100:00100000:2.0:1789061966.421599:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120328960 00000100:00100000:2.0:1789061966.421711:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 188 00000100:00100000:2.0:1789061966.421722:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:12343:x1875967120328960:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789061966.421766:0:6498:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789061966.421932:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:12343:x1875967120328960:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 211us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061966.421939:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 188 00000100:00100000:2.0:1789061966.428377:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061966.428470:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120329216 00000100:00100000:0.0:1789061966.428485:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120329216 00000100:00100000:0.0:1789061966.428580:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:0.0:1789061966.428594:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:12343:x1875967120329216:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061966.428636:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061966.428640:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789061966.428698:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce800/0x2774d8f311dc73bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bac6 expref: 62 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.428730:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:0.0:1789061966.428737:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061966.428757:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc740f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3badb expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789061966.429469:0:8435:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789061966.433044:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc7416 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.433075:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc7416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.433090:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc7416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.433178:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc740f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3badb expref: 64 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.433196:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc7416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3badb expref: 63 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.433207:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9767f385f800) 00010000:00010000:0.0:1789061966.433210:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061966.433214:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198200, rc 0) 00000100:00100000:0.0:1789061966.433311:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+63:12343:x1875967120329216:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 4720us (4948us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789061966.433333:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 189 00000100:00100000:0.0:1789061966.438565:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061966.438661:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120329472 00000100:00100000:2.0:1789061966.438688:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120329472 00000100:00100000:2.0:1789061966.438768:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:2.0:1789061966.438780:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+63:12343:x1875967120329472:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789061966.438874:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061966.438907:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc7416 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3badb expref: 63 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.438934:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9767f385f800) 00010000:00010000:2.0:1789061966.438949:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061966.438980:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7424 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.438995:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7424 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439008:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7424 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439189:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc742b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xee75431c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439228:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc742b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xee75431c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439241:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc742b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xee75431c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439307:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7424 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439314:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7424 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439321:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7424 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439327:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061966.439331:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7424 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439339:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7424 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439350:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:2.0:1789061966.439353:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061966.439358:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7424 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439439:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce400/0x2774d8f311dc7424 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439460:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc742b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xee75431c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439472:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc742b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xee75431c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439478:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc742b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xee75431c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439483:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cfa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061966.439487:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc742b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xee75431c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439493:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc742b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xee75431c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439502:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xee75431c (ffff9767d1235d00) 00010000:00010000:2.0:1789061966.439504:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061966.439507:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc742b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xee75431c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.439512:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cfa00/0x2774d8f311dc742b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xee75431c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061966.439809:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:12343:x1875967120329472:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 1021us (1249us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789061966.439819:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 190 00000100:00100000:1.0:1789061966.446560:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061966.446630:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120329600 00000100:00100000:1.0:1789061966.446643:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120329600 00000100:00100000:1.0:1789061966.446724:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 191 00000100:00100000:1.0:1789061966.446737:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+62:12343:x1875967120329600:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061966.446764:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061966.446799:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7432 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bae2 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.446857:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7439 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.446884:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.446901:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.447903:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7432 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae2 expref: 64 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.448539:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae2 expref: 63 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.448556:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:1.0:1789061966.448559:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789061966.448564:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47be00, rc 0) 00000100:00100000:1.0:1789061966.448938:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+63:12343:x1875967120329600:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 2200us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061966.448950:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 191 00000040:00080000:2.0:1789061966.455392:0:14580:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789061966.455402:0:14580:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789061966.455437:0:14580:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789061966.455444:0:14580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789061966.456722:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061966.456767:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120329856 00000100:00100000:0.0:1789061966.456776:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120329856 00000100:00100000:0.0:1789061966.456826:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:0.0:1789061966.456836:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+63:12343:x1875967120329856:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789061966.456914:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7440 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.456931:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7440 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.456942:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7440 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789061966.457422:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1789061966.457432:0:8435:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347566825338ns, next at 348566822848ns, rc = 0 00000004:00010000:0.0:1789061966.457481:0:8435:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009eb4895a reply state 0000000011593b6d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7440 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.457495:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7440 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.457502:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:0.0:1789061966.457505:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789061966.457509:0:8435:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061966.458195:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+65:12343:x1875967120329856:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 1356us (1475us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789061966.458216:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 192 00000100:00100000:0.0:1789061966.467768:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061966.467838:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120329984 00000100:00100000:1.0:1789061966.467856:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120329984 00000100:00100000:1.0:1789061966.468361:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:1.0:1789061966.468376:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+65:12343:x1875967120329984:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061966.468408:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061966.468436:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc7447 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bae9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.468516:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc7447 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae9 expref: 66 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.468548:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc7447 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae9 expref: 66 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.468583:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:1.0:1789061966.468587:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061966.468592:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a000, rc 0) 00000100:00100000:1.0:1789061966.468705:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+66:12343:x1875967120329984:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 333us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061966.468713:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 193 00000100:00100000:1.0:1789061966.476720:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061966.476783:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120330112 00000100:00100000:1.0:1789061966.476795:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120330112 00000100:00100000:1.0:1789061966.476887:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:1.0:1789061966.476901:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2393:x1875967120330112:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789061966.477199:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2393:x1875967120330112:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 301us (494us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789061966.477209:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00080000:1.0:1789061966.477236:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789061966.500799:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061966.501079:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120330368 00000100:00100000:0.0:1789061966.501088:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120330368 00000100:00100000:0.0:1789061966.501139:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:0.0:1789061966.501148:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+66:12343:x1875967120330368:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789061966.501377:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:12343:x1875967120330368:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 230us (598us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1789061966.501386:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000004:00080000:3.0:1789061966.506076:0:8612:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347615466557ns, next at 348615463358ns, rc = 0 00000100:00100000:3.0:1789061966.506219:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789061966.506246:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130873856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061966.506351:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061966.506429:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130873856 00000100:00100000:3.0:1789061966.506439:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130873856 00000100:00100000:3.0:1789061966.506508:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789061966.506519:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875967130873856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789061966.506555:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789061966.506627:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3622:x1875967130873856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061966.506634:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1789061966.506659:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061966.506718:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130873856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061966.506917:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130873984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061966.510825:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061966.511107:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061966.511335:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130873984 00000100:00100000:0.0:1789061966.511347:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130873984 00000100:00100000:0.0:1789061966.511426:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789061966.511437:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130873984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789061966.511479:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00080000:2.0:1789061966.511486:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061966.511563:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130873984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061966.511571:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789061966.511781:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130873984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061966.511820:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120330624 00000100:00100000:1.0:1789061966.511828:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120330624 00000100:00100000:1.0:1789061966.511871:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 194 00000100:00100000:1.0:1789061966.511878:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:12343:x1875967120330624:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789061966.512005:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:12343:x1875967120330624:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 128us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061966.512013:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 194 00000100:00100000:1.0:1789061966.521629:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.521760:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120330752 00000100:00100000:3.0:1789061966.521774:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120330752 00000100:00100000:3.0:1789061966.521836:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 195 00000100:00100000:3.0:1789061966.521854:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:12343:x1875967120330752:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061966.521873:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061966.521893:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc744e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3baf0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.521963:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7455 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.521977:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7455 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.521988:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7455 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061966.522058:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789061966.522084:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7455 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.522110:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc744e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baf0 expref: 69 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.522129:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7455 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baf0 expref: 68 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.522137:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:3.0:1789061966.522140:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789061966.522144:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807a200, rc 0) 00000100:00100000:3.0:1789061966.522860:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:12343:x1875967120330752:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1004us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061966.522869:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 195 00000100:00100000:0.0:1789061966.526839:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061966.526930:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120330880 00000100:00100000:1.0:1789061966.526943:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120330880 00000100:00100000:1.0:1789061966.527014:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:1.0:1789061966.527025:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2391:x1875967120330880:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061966.527050:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061966.527079:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc745c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3baf7 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061966.527112:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2eb4d, blocks: 0x0 00010000:00010000:1.0:1789061966.527205:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1789061966.527211:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061966.527223:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc745c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baf7 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.527246:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc745c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baf7 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.527262:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b800, rc 0) 00000100:00100000:1.0:1789061966.527335:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2391:x1875967120330880:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 311us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061966.527343:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:3.0:1789061966.541792:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.541844:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120331136 00000100:00100000:3.0:1789061966.541856:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120331136 00000100:00100000:3.0:1789061966.541923:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 196 00000100:00100000:3.0:1789061966.541934:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767ffe49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:12343:x1875967120331136:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789061966.542078:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767ffe49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:12343:x1875967120331136:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 145us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061966.542087:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 196 00000100:00100000:0.0:1789061966.555418:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061966.555504:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120331264 00000100:00100000:1.0:1789061966.555518:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120331264 00000100:00100000:1.0:1789061966.555594:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:1.0:1789061966.555647:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:12343:x1875967120331264:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061966.555682:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061966.555707:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bafe expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.555750:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc745c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baf7 expref: 9 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.555761:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061966.555766:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061966.555772:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bafe expref: 9 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.555815:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc745c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baf7 expref: 9 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.555831:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc745c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baf7 expref: 9 pid: 8412 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061966.555849:0:8411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1875967130874112:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061966.555956:0:8411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789061966.560442:0:8411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1875967130874112:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061966.560494:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bafe expref: 9 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.560537:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47ba00, rc 0) 00000100:00100000:1.0:1789061966.560636:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:12343:x1875967120331264:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 5031us (5234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061966.560646:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:3.0:1789061966.564564:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061966.564702:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120331392 00000100:00100000:0.0:1789061966.564715:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120331392 00010000:00010000:0.0:1789061966.564767:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc745c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baf7 expref: 9 pid: 8412 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061966.564814:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:0.0:1789061966.564825:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2393:x1875967120331392:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061966.564859:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061966.564890:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc745c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baf7 expref: 9 pid: 8412 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.564908:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc745c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baf7 expref: 9 pid: 8412 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.564939:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc745c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baf7 expref: 9 pid: 8412 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.564958:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061966.564963:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061966.564975:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bafe expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.564988:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bafe expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.565034:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bafe expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061966.565063:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8410700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6481:1875967130874240:192.168.203.3@tcp:105: 00000100:00100000:0.0:1789061966.565278:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789061966.576549:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061966.577246:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8410700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6481:1875967130874240:192.168.203.3@tcp:105: 00010000:00010000:0.0:1789061966.577280:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061966.577359:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120331392:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 12535us (12819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061966.577371:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 87 00000100:00100000:2.0:1789061966.577894:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120331520 00000100:00100000:2.0:1789061966.577904:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120331520 00002000:00100000:2.0:1789061966.577961:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9766c8172d80 x1875967120331520/t0(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:387/0 lens 504/0 e 0 to 0 dl 1789061977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789061966.577972:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c8172d80 with x1875967120331520 ext(0->8) 00002000:00010000:2.0:1789061966.577978:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c8172d80 00000100:00100000:2.0:1789061966.579324:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:2.0:1789061966.579345:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120331520:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789061966.582422:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:2392:x1875967120331520:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 Request processed in 3070us (5872us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789061966.582439:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00002000:00100000:2.0:1789061966.582453:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9766c8172d80 x1875967120331520/t4294967315(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:387/0 lens 504/448 e 0 to 0 dl 1789061977 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789061966.582464:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c8172d80 with x1875967120331520 ext(0->8) 00002000:00010000:2.0:1789061966.582472:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c8172d80 00000100:00100000:0.0:1789061966.590330:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.592927:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120331648 00000100:00100000:3.0:1789061966.592959:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120331648 00000100:00100000:3.0:1789061966.593107:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 197 00000100:00100000:3.0:1789061966.593777:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:12343:x1875967120331648:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000004:00080000:2.0:1789061966.597757:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:2.0:1789061966.597813:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1789061966.597825:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:2.0:1789061966.597892:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789061966.597903:0:6474:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9766c7727900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789061966.597909:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767c9c3c900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9766c7727180 00000020:00080000:2.0:1789061966.597912:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767c9c3c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9766c63d1800 00010000:00010000:2.0:1789061966.597977:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.597991:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.597999:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598006:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061966.598011:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598021:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598388:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767d1235200) 00010000:00010000:2.0:1789061966.598393:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061966.598399:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598407:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc71d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598439:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598447:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598453:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598472:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061966.598475:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598481:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598491:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061966.598493:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061966.598497:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598503:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc72d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598515:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc72f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598521:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc72f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598526:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc72f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598531:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061966.598534:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc72f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598540:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc72f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598559:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061966.598562:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061966.598565:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc72f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598571:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc72f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598585:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc733d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598591:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc733d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598597:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc733d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598603:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061966.598634:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc733d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598641:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc733d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598648:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061966.598651:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061966.598654:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc733d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598660:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a400/0x2774d8f311dc733d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598693:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7440 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598699:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7440 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598706:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7440 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598712:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061966.598715:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7440 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598721:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7440 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598729:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:2.0:1789061966.598732:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789061966.598735:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7440 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.598742:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7440 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789061966.598834:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789061966.598901:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789061966.598925:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c3066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130874368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789061966.599012:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061966.599925:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c8f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130874496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789061966.599985:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061966.600058:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130874368 00000100:00100000:3.0:1789061966.600067:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130874368 00000100:00100000:3.0:1789061966.600247:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130874496 00000100:00100000:3.0:1789061966.600252:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130874496 00000100:00100000:3.0:1789061966.600297:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789061966.600308:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3621:x1875967130874368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789061966.600347:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1789061966.600389:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa2eb4a, atime: 0x6aa2eb4a, ctime: 0x6aa2eb4a, blocks: 0x8 00010000:00010000:3.0:1789061966.600398:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc746a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.600417:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1789061966.600422:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061966.600429:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc746a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.600447:0:8413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc746a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.600459:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc746a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.600481:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc746a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.600501:0:8413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789061966.600722:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3621:x1875967130874368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 415us (1710us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789061966.600731:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789061966.600752:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789061966.600759:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130874496:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1789061966.600944:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9767c3066680/2, rc 0, transno 4294967308 00000100:00100000:2.0:1789061966.600951:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c3066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130874368:0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1789061966.601232:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789061966.601237:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789061965 00002000:00010000:3.0:1789061966.601440:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789061966.601444:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789061965 -> 1789061965 00002000:00010000:3.0:1789061966.601446:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789061966.601497:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1875967130874496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 737us (1510us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789061966.601505:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1789061966.601534:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789061966.601552:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061966.601560:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc746a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.601571:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789061966.601576:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc746a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.601599:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc746a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.601641:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc746a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.601649:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc746a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.601681:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061966.601684:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061966.601685:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061966.601803:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061966.602275:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:12343:x1875967120331648:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 8509us (11958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061966.602285:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 197 00000100:00100000:3.0:1789061966.603328:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.603352:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.603369:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.603388:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.603415:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120331776 00000100:00100000:3.0:1789061966.603425:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120331776 00000100:00100000:3.0:1789061966.603473:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 382 00000100:00100000:3.0:1789061966.603481:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c336b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2390:x1875967120331776:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061966.603540:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c336b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:21c8093b-edf9-482d-a900-a6298c53147f+13:2390:x1875967120331776:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 60us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061966.603547:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 382 00000100:00100000:3.0:1789061966.603576:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120332288 00000100:00100000:3.0:1789061966.603585:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120332288 00000100:00100000:3.0:1789061966.603628:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120331904 00000100:00100000:3.0:1789061966.603631:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120331904 00000100:00100000:3.0:1789061966.603645:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120332160 00000100:00100000:3.0:1789061966.603647:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120332160 00000100:00100000:3.0:1789061966.603661:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 298 00000100:00100000:3.0:1789061966.603678:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120332288:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061966.603707:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120332288:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061966.603713:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 298 00000100:00100000:3.0:1789061966.603723:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 299 00000100:00100000:3.0:1789061966.603728:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120331904:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061966.603745:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120331904:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 17us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061966.603751:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 299 00000100:00100000:3.0:1789061966.603759:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 300 00000100:00100000:3.0:1789061966.603764:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120332160:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061966.603781:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120332160:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 17us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061966.603786:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 300 00000100:00080000:3.0:1789061966.603812:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789061966.603816:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1789061966.603856:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9767c8f7f100/2, rc 0, transno 4294967316 00000100:00100000:3.0:1789061966.603863:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c8f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130874496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789061966.605523:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120332032 00000100:00100000:3.0:1789061966.605534:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120332032 00000100:00100000:3.0:1789061966.605634:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:3.0:1789061966.605644:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2390:x1875967120332032:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061966.605736:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2390:x1875967120332032:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 94us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061966.605744:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00080000:2.0:1789061966.606356:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061966.609546:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.609653:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120332416 00000100:00100000:3.0:1789061966.609676:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120332416 00000100:00100000:3.0:1789061966.609871:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:3.0:1789061966.609884:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:2393:x1875967120332416:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789061966.611849:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1789061966.611868:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1789061966.612134:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2393:x1875967120332416:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 2246us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061966.612147:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:3.0:1789061966.618508:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061966.618578:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120332672 00000100:00100000:0.0:1789061966.618591:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120332672 00000100:00100000:0.0:1789061966.618678:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 198 00000100:00100000:0.0:1789061966.618688:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:12343:x1875967120332672:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789061966.618760:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061966.618813:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a200/0x2774d8f311dc7455 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3baf0 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.618831:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:0.0:1789061966.618837:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061966.618875:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7471 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.618894:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7471 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.618905:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7471 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061966.619071:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e04b2ac8 reply state 000000003d687f3f transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7471 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.619084:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7471 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.619107:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:0.0:1789061966.619110:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789061966.619113:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061966.619238:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:12343:x1875967120332672:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 550us (746us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1789061966.619247:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 198 00000100:00100000:2.0:1789061966.621849:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.622013:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120332800 00000100:00100000:3.0:1789061966.622025:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120332800 00000100:00100000:3.0:1789061966.622112:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:3.0:1789061966.622234:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2393:x1875967120332800:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789061966.622434:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789061966.622439:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789061965 -> 1789061964 00002000:00010000:3.0:1789061966.622441:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789061962 00002000:00010000:3.0:1789061966.622444:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789061965 -> 1789061964 00002000:00010000:3.0:1789061966.622446:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789061966.622524:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120332800:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 294us (687us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789061966.624186:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1789061966.626217:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.626400:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120333056 00000100:00100000:3.0:1789061966.626413:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120333056 00000100:00100000:3.0:1789061966.626482:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 199 00000100:00100000:3.0:1789061966.626495:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:12343:x1875967120333056:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789061966.626597:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.626645:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7439 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae2 expref: 20 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.626655:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.626710:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae2 expref: 20 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.626726:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7439 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae2 expref: 20 pid: 10077 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061966.626743:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130874624:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061966.626864:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0240 going to sleep for 11 seconds 00000100:00100000:2.0:1789061966.633951:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061966.633988:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120333184 00000100:00100000:2.0:1789061966.634026:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120333184 00000100:00100000:3.0:1789061966.634087:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130874624:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061966.634266:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.635028:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061966.635377:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7439 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae2 expref: 21 pid: 10077 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061966.635441:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:2.0:1789061966.635452:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767cdb77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:2392:x1875967120333184:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061966.635471:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061966.635479:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7439 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae2 expref: 21 pid: 10077 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.635494:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae2 expref: 21 pid: 10077 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.635521:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7439 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae2 expref: 21 pid: 10077 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.635536:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:2.0:1789061966.635548:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.635741:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.635750:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.635783:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061966.635967:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767cdb77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:2392:x1875967120333184:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 514us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061966.635977:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 88 00010000:00010000:3.0:1789061966.636188:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.636197:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.636252:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.636260:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.636267:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.636273:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061966.636278:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.636286:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.636295:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:3.0:1789061966.636298:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789061966.636302:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.636307:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7478 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061966.636351:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:12343:x1875967120333056:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 Request processed in 9859us (10147us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789061966.636359:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 199 00000100:00100000:3.0:1789061966.651250:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.651298:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120333312 00000100:00100000:3.0:1789061966.651310:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120333312 00000100:00100000:3.0:1789061966.651395:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:3.0:1789061966.651408:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2391:x1875967120333312:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789061966.651466:0:8613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.651503:0:8613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bafe expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.651513:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061966.651518:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061966.651523:0:8613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.651568:0:8613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bafe expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.651586:0:8613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bafe expref: 8 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061966.651656:0:8613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8613:1875967130874752:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061966.651767:0:8613:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789061966.661417:0:8613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8613:1875967130874752:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061966.661457:0:8613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061966.662266:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.662314:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120333440 00000100:00100000:3.0:1789061966.662323:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120333440 00010000:00010000:3.0:1789061966.662368:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bafe expref: 9 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061966.662409:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:3.0:1789061966.662420:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2392:x1875967120333440:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061966.662437:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061966.662461:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bafe expref: 9 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662475:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bafe expref: 9 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662504:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000089571b5/0x2774d8f311dc7463 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bafe expref: 9 pid: 8411 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662520:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061966.662526:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061966.662532:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662543:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662584:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061966.662676:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120333440:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 246us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061966.662691:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 89 00010000:00010000:3.0:1789061966.662720:0:8613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662730:0:8613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662752:0:8613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662760:0:8613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662768:0:8613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662776:0:8613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789061966.662780:0:8613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662790:0:8613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662802:0:8613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.662820:0:8613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc747f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061966.662875:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2391:x1875967120333312:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 11470us (11640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061966.662883:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:3.0:1789061966.670014:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061966.670476:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120333696 00000100:00100000:0.0:1789061966.670489:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120333696 00000100:00100000:0.0:1789061966.670565:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 200 00000100:00100000:0.0:1789061966.670577:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:12343:x1875967120333696:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789061966.670712:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.670733:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc72cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba87 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.670744:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.670784:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc72cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba87 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.670800:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc72cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba87 expref: 19 pid: 6496 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061966.670874:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8413480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130874880:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061966.671180:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789061966.674128:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8413480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130874880:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061966.674166:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061966.675317:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.685642:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120333824 00000100:00100000:3.0:1789061966.685673:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120333824 00010000:00010000:3.0:1789061966.685742:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc72cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba87 expref: 20 pid: 6496 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061966.685886:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00100000:2.0:1789061966.685902:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:2392:x1875967120333824:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061966.685924:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061966.685933:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc72cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba87 expref: 20 pid: 6496 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.685950:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc72cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba87 expref: 20 pid: 6496 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.685977:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc72cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba87 expref: 20 pid: 6496 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.685994:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061966.686001:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.686030:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.686493:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.686534:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061966.686702:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:2392:x1875967120333824:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 803us (11392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061966.686712:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 90 00010000:00010000:1.0:1789061966.692972:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.692995:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.693283:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.693305:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc7447 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae9 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.693316:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.693365:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc7447 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae9 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061966.693381:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc7447 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae9 expref: 19 pid: 6497 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061966.693398:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130875008:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061966.693536:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789061966.703349:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.703675:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130875008:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061966.703721:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061966.706469:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120333952 00000100:00100000:2.0:1789061966.706488:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120333952 00010000:00010000:3.0:1789061966.706657:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc7447 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae9 expref: 20 pid: 6497 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061966.706727:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:3.0:1789061966.706741:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8413800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:2393:x1875967120333952:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061966.706781:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061966.706844:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc7447 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae9 expref: 20 pid: 6497 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.706861:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc7447 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae9 expref: 20 pid: 6497 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.706888:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc7447 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bae9 expref: 20 pid: 6497 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.706909:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:3.0:1789061966.706915:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.706999:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.707009:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.707049:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061966.707135:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8413800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:2393:x1875967120333952:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 396us (3800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061966.707143:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 91 00010000:00010000:0.0:1789061966.708452:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.708468:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061966.708650:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1789061966.708802:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1789061966.708839:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1789061966.708947:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8410000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6496:1875967130875136:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789061966.709050:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061966.709091:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789061966.709336:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130875136 00000100:00100000:2.0:1789061966.709346:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130875136 00000100:00100000:2.0:1789061966.709397:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789061966.709407:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6496:x1875967130875136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789061966.709504:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6496:x1875967130875136:12345-0@lo:1000:mdt00_000.0 Request processed in 99us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061966.709512:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789061966.709697:0:6496:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1789061966.709705:0:6496:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9767c8f7f100, transno 4294967316 00000100:00100000:0.0:1789061966.709758:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8410000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6496:1875967130875136:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789061966.709903:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1789061966.709950:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8410000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6496:1875967130875264:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789061966.709983:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061966.710012:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789061966.710332:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130875264 00000100:00100000:3.0:1789061966.710339:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130875264 00000100:00100000:3.0:1789061966.710383:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789061966.710391:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6496:x1875967130875264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789061966.710509:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6496:x1875967130875264:12345-0@lo:1000:mdt00_000.0 Request processed in 119us (525us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789061966.710531:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789061966.710579:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8410000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6496:1875967130875264:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789061966.710653:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710673:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710682:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710689:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061966.710695:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710703:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710721:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:3.0:1789061966.710724:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061966.710730:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710737:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc748d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710763:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc73c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710769:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc73c2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710786:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc73c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710791:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cee00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061966.710794:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc73c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710800:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc73c2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710808:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:3.0:1789061966.710811:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789061966.710814:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc73c2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710820:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc73c2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710846:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710861:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bacd expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710872:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710902:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bacd expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.710916:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bacd expref: 22 pid: 6496 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061966.710935:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130875392:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061966.711011:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061966.720740:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061966.720833:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120334080 00000100:00100000:2.0:1789061966.720846:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120334080 00010000:00010000:2.0:1789061966.720899:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bacd expref: 23 pid: 6496 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061966.720951:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00100000:2.0:1789061966.720963:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8412680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:2392:x1875967120334080:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061966.720983:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061966.721019:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bacd expref: 23 pid: 6496 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.721033:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bacd expref: 23 pid: 6496 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.721061:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:2.0:1789061966.721066:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.721078:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.721086:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.721109:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061966.721245:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8412680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:2392:x1875967120334080:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 283us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061966.721254:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 92 00010000:00010000:3.0:1789061966.721502:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc73de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bacd expref: 22 pid: 6496 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061966.721578:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130875392:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061966.721648:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721659:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721676:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721691:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721698:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721706:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721713:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061966.721718:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721726:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721747:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:3.0:1789061966.721750:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061966.721756:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721762:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc7494 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721773:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721778:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721783:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721788:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061966.721791:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721797:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721804:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f500) 00010000:00010000:3.0:1789061966.721806:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789061966.721809:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061966.721814:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc7486 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061966.722035:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:12343:x1875967120333696:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 51459us (52043us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789061966.722044:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 200 00000020:00080000:3.0:1789061966.722049:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789061966.722180:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061966.722186:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061966.722752:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:1.0:1789061966.722765:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789061966.725853:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061966.725946:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120334336 00000100:00100000:3.0:1789061966.725958:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120334336 00000100:00100000:3.0:1789061966.726460:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1789061966.726473:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f05450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:12343:x1875967120334336:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789061966.728284:0:6500:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789061966.728333:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1789061966.728444:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc749b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.728465:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc749b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.728480:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc749b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.728514:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc749b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.728521:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc749b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.728528:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc749b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061966.728742:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789061966.728882:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f05450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:12343:x1875967120334336:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 2408us (3039us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789061966.728894:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000020:00080000:2.0:1789061966.728900:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789061966.730682:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061966.730702:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc749b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.730715:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789061966.730730:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc749b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.730765:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc749b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.730784:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:0.0:1789061966.730788:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789061966.730796:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc749b lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.730803:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf800/0x2774d8f311dc749b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061966.730823:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061966.730825:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061966.730827:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061967.660603:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061968.042825:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130875904:0@lo:400:kworker.0 00000100:00100000:3.0:1789061968.042921:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061968.042989:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130875904 00000100:00100000:0.0:1789061968.042999:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130875904 00000100:00100000:0.0:1789061968.043068:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789061968.043079:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130875904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061968.043115:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130876416:0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.043147:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130875904:12345-0@lo:400:kworker.0 Request processed in 69us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061968.043156:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789061968.043162:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061968.043190:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130876416 00000100:00100000:0.0:1789061968.043194:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130876416 00000100:00100000:3.0:1789061968.043202:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c82a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130876928:0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.043235:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789061968.043242:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130876416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.043274:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130876416:12345-0@lo:400:kworker.0 Request processed in 33us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061968.043291:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789061968.043597:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061968.043688:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130875904:0@lo:400:kworker.0 00000100:00100000:3.0:1789061968.043702:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130876416:0@lo:400:kworker.0 00000100:00100000:3.0:1789061968.043724:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789061968.043733:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130875520:0@lo:400:kworker.0 00000100:00080000:0.0:1789061968.043744:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061968.043763:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130875776:0@lo:400:kworker.0 00000100:00100000:3.0:1789061968.043772:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061968.043804:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130876032:0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.043811:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061968.043840:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061968.043843:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130876288:0@lo:400:kworker.0 00000100:00100000:3.0:1789061968.043869:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130876544:0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.043881:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061968.043904:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061968.043910:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c82a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130876800:0@lo:400:kworker.0 00000100:00100000:3.0:1789061968.043945:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c82a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130877056:0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.043950:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061968.046430:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130876928 00000100:00100000:2.0:1789061968.046450:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130876928 00000100:00100000:2.0:1789061968.046530:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130876544 00000100:00100000:2.0:1789061968.046534:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130876544 00000100:00100000:0.0:1789061968.047062:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789061968.047082:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130875648:0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.047157:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061968.047184:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130876160:0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.047209:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061968.047228:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c82a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130876672:0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.047255:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061968.047300:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130876288 00000100:00100000:0.0:1789061968.047306:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130876288 00000100:00100000:0.0:1789061968.047339:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130876800 00000100:00100000:0.0:1789061968.047343:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130876800 00000100:00100000:0.0:1789061968.047442:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130875648 00000100:00100000:0.0:1789061968.047446:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130875648 00000100:00100000:0.0:1789061968.047461:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130876160 00000100:00100000:0.0:1789061968.047464:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130876160 00000100:00100000:0.0:1789061968.047477:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130876672 00000100:00100000:0.0:1789061968.047479:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130876672 00000100:00100000:0.0:1789061968.047498:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789061968.047508:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130876288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.047595:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130876288:12345-0@lo:400:kworker.0 Request processed in 88us (3715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061968.047624:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789061968.047647:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789061968.047667:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130876800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061968.047760:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789061968.047770:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130876928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061968.047816:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130876928:12345-0@lo:400:kworker.0 Request processed in 48us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061968.047823:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789061968.047838:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130876800:12345-0@lo:400:kworker.0 Request processed in 47us (3753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061968.047839:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789061968.047851:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3622:x1875967130876544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.047851:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789061968.047871:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789061968.047879:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130875648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061968.047893:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3622:x1875967130876544:12345-0@lo:400:kworker.0 Request processed in 44us (3989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061968.047900:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789061968.047924:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130875648:12345-0@lo:400:kworker.0 Request processed in 45us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061968.047936:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789061968.047940:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061968.047946:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130875520 00000100:00100000:2.0:1789061968.047952:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130875520 00000100:00100000:0.0:1789061968.047959:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789061968.047969:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130876160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061968.047987:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789061968.047996:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130875520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.048201:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130876160:12345-0@lo:400:kworker.0 Request processed in 233us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061968.048209:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3368850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3622:x1875967130875520:12345-0@lo:400:kworker.0 Request processed in 213us (4437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061968.048209:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789061968.048222:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1789061968.048230:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789061968.048239:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130876672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061968.048260:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130877056 00000100:00100000:2.0:1789061968.048265:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130877056 00000100:00100000:0.0:1789061968.048274:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130876672:12345-0@lo:400:kworker.0 Request processed in 37us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061968.048282:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789061968.048297:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789061968.048302:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c82a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130876928:0@lo:400:kworker.0 00000100:00100000:2.0:1789061968.048304:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1875967130877056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061968.048338:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3622:1875967130875520:0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.048338:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130875648:0@lo:400:kworker.0 00000100:00100000:2.0:1789061968.048343:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1875967130877056:12345-0@lo:400:kworker.0 Request processed in 38us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061968.048349:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789061968.048356:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130876544:0@lo:400:kworker.0 00000100:00100000:3.0:1789061968.048367:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c82a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130877056:0@lo:400:kworker.0 00000100:00080000:2.0:1789061968.048373:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061968.048378:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789061968.048381:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789061968.048383:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061968.048395:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130875776 00000100:00100000:3.0:1789061968.048399:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130875776 00000100:00100000:3.0:1789061968.048425:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130876032 00000100:00100000:3.0:1789061968.048428:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130876032 00000100:00100000:3.0:1789061968.048441:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789061968.048447:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130875776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061968.048691:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789061968.048781:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130876032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061968.048832:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130876032:12345-0@lo:400:kworker.0 Request processed in 132us (4992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061968.048838:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789061968.048871:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130876032:0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.048937:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130876160:0@lo:400:kworker.0 00000100:00100000:0.0:1789061968.048949:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c82a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130876672:0@lo:400:kworker.0 00010000:00080000:0.0:1789061968.048966:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c83e3100 x1875967130876288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061968.048977:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130876288:0@lo:400:kworker.0 00010000:00080000:0.0:1789061968.048989:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c82a5f80 x1875967130876800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061968.048997:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c82a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130876800:0@lo:400:kworker.0 00000100:00100000:3.0:1789061968.050686:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130875776:12345-0@lo:400:kworker.0 Request processed in 2230us (6870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061968.050702:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789061968.051199:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130875776:0@lo:400:kworker.0 00000040:00080000:1.0:1789061968.478868:0:14631:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061968.478882:0:14631:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061968.478925:0:14631:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789061968.478935:0:14631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061968.553861:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c82a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130877184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789061968.553960:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061968.554116:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130877184 00000100:00100000:3.0:1789061968.554127:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130877184 00000100:00100000:3.0:1789061968.554191:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789061968.554202:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875967130877184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061968.554660:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789061968.554886:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c80a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130877440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789061968.554929:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061968.554976:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130877440 00000100:00100000:2.0:1789061968.554982:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130877440 00000100:00100000:2.0:1789061968.555020:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789061968.555027:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c8f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130877440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789061968.555057:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789061968.555094:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c8f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130877440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061968.555101:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789061968.555166:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c80a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130877440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061968.555327:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875967130877184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1126us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061968.555334:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789061968.555361:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130877312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061968.555400:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061968.557521:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c82a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130877184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061968.557762:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130877312 00000100:00100000:2.0:1789061968.557773:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130877312 00000100:00100000:2.0:1789061968.557839:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789061968.557849:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130877312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789061968.557874:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789061968.557966:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130877312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (2564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061968.557972:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789061968.558108:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130877312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061968.664372:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061968.664418:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120334592 00000100:00100000:3.0:1789061968.664430:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120334592 00000100:00100000:3.0:1789061968.664523:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00100000:3.0:1789061968.664535:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:12361:x1875967120334592:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789061968.664567:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061968.664595:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc74a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb05 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061968.664776:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc74a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061968.664796:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc74a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061968.664813:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc74a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061968.664826:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789061968.664953:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc74a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb05 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061968.664974:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc74a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb05 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061968.664983:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:3.0:1789061968.664986:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789061968.664991:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807b600, rc 0) 00000100:00100000:3.0:1789061968.665074:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:12361:x1875967120334592:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 542us (719us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789061968.665082:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 201 00000100:00080000:3.0:1789061968.665107:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061968.672768:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061968.673359:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120334720 00000100:00100000:0.0:1789061968.673372:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120334720 00000100:00100000:0.0:1789061968.673452:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 202 00000100:00100000:0.0:1789061968.673465:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:12361:x1875967120334720:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:0.0:1789061968.673569:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74b7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673594:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673627:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673646:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673662:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673681:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673787:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673795:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673802:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061968.673859:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673873:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673881:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74b7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673888:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673895:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061968.673901:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673909:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74b7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673922:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:0.0:1789061968.673931:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061968.673938:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673945:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673959:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673965:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673971:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673975:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061968.673978:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673983:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.673990:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767f385fe00) 00010000:00010000:0.0:1789061968.673993:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061968.673995:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74be lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.674000:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.674019:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.674030:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.674036:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.674041:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061968.674044:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.674049:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.674056:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385f900) 00010000:00010000:0.0:1789061968.674058:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061968.674062:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.674068:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061968.674170:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:12361:x1875967120334720:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 706us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061968.674179:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 202 00010000:00010000:0.0:1789061968.682909:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061968.732204:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061968.732284:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120334976 00000100:00100000:0.0:1789061968.732298:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120334976 00000100:00100000:0.0:1789061968.732382:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 203 00000100:00100000:0.0:1789061968.732394:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:12364:x1875967120334976:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061968.732444:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061968.732472:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb0c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.732578:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.732597:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.732667:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.732684:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.732691:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.732699:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.732835:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc74e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.732844:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc74e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.732851:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc74e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061968.732863:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789061968.732969:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.732978:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.732985:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.732992:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061968.732998:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733006:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733020:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:0.0:1789061968.733023:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061968.733028:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733034:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc74d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733053:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733059:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733065:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733071:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061968.733082:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733093:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733101:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767f385f900) 00010000:00010000:0.0:1789061968.733103:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061968.733106:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733116:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc74da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733166:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb0c expref: 28 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733182:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc74e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb0c expref: 27 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.733190:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:0.0:1789061968.733193:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061968.733195:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198e00, rc 0) 00000100:00100000:0.0:1789061968.733270:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:12364:x1875967120334976:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 877us (1080us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789061968.733277:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 203 00000100:00100000:2.0:1789061968.736774:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061968.742830:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120335104 00000100:00100000:0.0:1789061968.742853:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120335104 00000100:00100000:0.0:1789061968.743192:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 204 00000100:00100000:0.0:1789061968.743206:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c80a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:12364:x1875967120335104:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1789061968.743318:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.743341:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.743357:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.743404:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.743411:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.743419:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.743425:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061968.743430:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.743438:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.743452:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:0.0:1789061968.743455:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789061968.743461:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.743467:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc74ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061968.743592:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c80a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:12364:x1875967120335104:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 389us (6833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061968.743601:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 204 00000040:00080000:3.0:1789061968.749445:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789061968.751514:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061968.751852:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120335360 00000100:00100000:0.0:1789061968.751861:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120335360 00000100:00100000:0.0:1789061968.751929:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:0.0:1789061968.751940:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:12364:x1875967120335360:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1789061968.752165:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+28:12364:x1875967120335360:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 225us (659us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789061968.752176:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:3.0:1789061968.800167:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061968.800265:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120335616 00000100:00100000:1.0:1789061968.800275:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120335616 00000100:00100000:1.0:1789061968.800347:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 205 00000100:00100000:1.0:1789061968.800358:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+28:11888:x1875967120335616:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1789061968.800382:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061968.800412:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc74f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb13 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.800513:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.800526:0:10077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc74e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb0c expref: 29 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.800534:0:10077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.800578:0:10077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc74e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb0c expref: 29 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.800594:0:10077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc74e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb0c expref: 29 pid: 8435 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061968.800658:0:10077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130877568:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061968.800755:0:10077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789061968.807582:0:10077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130877568:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061968.807636:0:10077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061968.807933:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061968.808996:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120335744 00000100:00100000:0.0:1789061968.809005:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120335744 00010000:00010000:0.0:1789061968.809112:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc74e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb0c expref: 30 pid: 8435 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061968.809204:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 93 00000100:00100000:0.0:1789061968.809213:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:2390:x1875967120335744:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061968.809227:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061968.809234:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc74e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb0c expref: 30 pid: 8435 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.809246:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc74e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb0c expref: 30 pid: 8435 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.809267:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198e00/0x2774d8f311dc74e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb0c expref: 30 pid: 8435 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.809313:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:0.0:1789061968.809319:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.809327:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.809334:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.809364:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061968.809473:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:2390:x1875967120335744:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 261us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061968.809480:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 93 00010000:00010000:1.0:1789061968.809549:0:10077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.809557:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061968.809586:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789061968.809736:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc74f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb13 expref: 30 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.809752:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb13 expref: 29 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.809760:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:1.0:1789061968.809762:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789061968.809765:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a000, rc 0) 00000100:00100000:1.0:1789061968.809792:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:11888:x1875967120335616:12345-192.168.203.3@tcp:101:bash.0 Request processed in 9436us (9634us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789061968.809799:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 205 00000040:00080000:1.0:1789061968.813016:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061968.813025:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061968.813133:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789061968.813140:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061968.814135:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061968.814221:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120335872 00000100:00100000:3.0:1789061968.814229:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120335872 00000100:00100000:3.0:1789061968.814310:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 206 00000100:00100000:3.0:1789061968.814320:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:11888:x1875967120335872:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1789061968.814340:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061968.814360:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc750b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb1a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061968.814389:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc7512 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061968.814402:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc7512 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061968.814413:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc7512 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061968.814519:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc750b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb1a expref: 31 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061968.814535:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc7512 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb1a expref: 30 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061968.814868:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:3.0:1789061968.814871:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789061968.814874:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807a800, rc 0) 00000100:00100000:3.0:1789061968.814928:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:11888:x1875967120335872:12345-192.168.203.3@tcp:101:bash.0 Request processed in 609us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061968.814935:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 206 00000100:00100000:2.0:1789061968.818847:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061968.818957:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120336128 00000100:00100000:0.0:1789061968.818966:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120336128 00000100:00100000:0.0:1789061968.819114:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 207 00000100:00100000:0.0:1789061968.819125:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:11888:x1875967120336128:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:0.0:1789061968.819434:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7519 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.819452:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.819463:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061968.819503:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1789061968.819526:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c3b0d67 reply state 000000001fbb5b94 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.819775:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.819782:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:0.0:1789061968.819784:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789061968.819788:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789061968.819972:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1789061968.820194:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+34:11888:x1875967120336128:12345-192.168.203.3@tcp:36:bash.0 Request processed in 1069us (1353us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789061968.820202:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 207 00000020:00080000:1.0:1789061968.820207:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789061968.822973:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061968.823125:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120336256 00000100:00100000:1.0:1789061968.823133:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120336256 00000100:00100000:1.0:1789061968.823235:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 208 00000100:00100000:1.0:1789061968.823246:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+34:11888:x1875967120336256:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1789061968.823285:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061968.823306:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7520 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb21 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.823362:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7520 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb21 expref: 35 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.823376:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7520 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb21 expref: 35 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.823395:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:1.0:1789061968.823398:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061968.823401:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47ba00, rc 0) 00000100:00100000:1.0:1789061968.823501:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+35:11888:x1875967120336256:12345-192.168.203.3@tcp:101:bash.0 Request processed in 257us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061968.823508:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 208 00000100:00100000:2.0:1789061968.826521:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061968.826673:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120336384 00000100:00100000:0.0:1789061968.826682:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120336384 00000100:00080000:3.0:1789061968.826790:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789061968.826833:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:0.0:1789061968.826844:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:11888:x1875967120336384:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1789061968.826859:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061968.826880:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7527 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb28 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789061968.826905:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa2eb4c, atime: 0x6aa2eb4a, ctime: 0x6aa2eb4c, blocks: 0x8 00010000:00010000:0.0:1789061968.826924:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1789061968.826928:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061968.826936:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7527 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb28 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.826950:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7527 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb28 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.826964:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198e00, rc 0) 00000100:00100000:0.0:1789061968.827021:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:11888:x1875967120336384:12345-192.168.203.3@tcp:101:bash.0 Request processed in 179us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061968.827466:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:3.0:1789061968.829708:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061968.829941:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120336512 00000100:00100000:0.0:1789061968.829950:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120336512 00002000:00010000:0.0:1789061968.829988:0:8418:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1789061968.829993:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c82a5180 with x1875967120336512 ext(0->18446744073709551615) 00002000:00010000:0.0:1789061968.830005:0:8418:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c82a5180. 00000100:00100000:0.0:1789061968.830047:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:0.0:1789061968.830065:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120336512:12345-192.168.203.3@tcp:10:bash.0 00002000:00010000:0.0:1789061968.830321:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789061968.830325:0:8418:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789061964 -> 1789061967 00002000:00010000:0.0:1789061968.830328:0:8418:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789061962 -> 1789061962 00002000:00010000:0.0:1789061968.830330:0:8418:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789061964 -> 1789061967 00002000:00010000:0.0:1789061968.830333:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789061968.830391:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2393:x1875967120336512:12345-192.168.203.3@tcp:10:bash.0 Request processed in 335us (690us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789061968.830399:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00002000:00010000:0.0:1789061968.830403:0:8418:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1789061968.830405:0:8418:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c82a5180 with x1875967120336512 ext(0->18446744073709551615) 00002000:00010000:0.0:1789061968.830411:0:8418:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c82a5180. 00000100:00100000:3.0:1789061968.924328:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061968.924433:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120336640 00000100:00100000:0.0:1789061968.924443:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120336640 00000100:00100000:0.0:1789061968.924503:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 209 00000100:00100000:0.0:1789061968.924513:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+35:12378:x1875967120336640:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:0.0:1789061968.924596:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc752e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924678:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc752e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924693:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc752e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924711:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7535 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924718:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7535 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924724:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7535 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924795:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc753c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924805:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc753c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924813:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc753c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061968.924856:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc753c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924867:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc752e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924872:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc752e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924889:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc752e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924896:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061968.924899:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc752e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924906:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc752e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924917:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:0.0:1789061968.924920:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061968.924924:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc752e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924930:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc752e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924941:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7535 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924946:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7535 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924951:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7535 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924957:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061968.924960:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7535 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924974:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7535 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924981:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767f385ff00) 00010000:00010000:0.0:1789061968.924983:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061968.924986:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7535 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.924992:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7535 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.925008:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc753c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.925013:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc753c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.925018:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc753c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.925033:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061968.925036:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc753c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.925042:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc753c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.925048:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:0.0:1789061968.925050:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061968.925052:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc753c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.925066:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc753c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061968.925140:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+35:12378:x1875967120336640:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 628us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061968.925148:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 209 00000100:00100000:2.0:1789061968.965005:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061968.965108:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120336896 00000100:00100000:1.0:1789061968.965119:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120336896 00000100:00100000:1.0:1789061968.965176:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 210 00000100:00100000:1.0:1789061968.965186:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+35:12381:x1875967120336896:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061968.965205:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061968.965225:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7543 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb2f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965304:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc754a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965319:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc754a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965373:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc754a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965392:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7551 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965399:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965406:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965516:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7558 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965526:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965532:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061968.965540:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789061968.965633:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc754a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965641:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc754a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965656:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc754a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965662:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ac00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061968.965672:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc754a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965679:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc754a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965691:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:1.0:1789061968.965694:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061968.965699:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc754a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965706:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ac00/0x2774d8f311dc754a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965719:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965725:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7551 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965730:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7551 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965735:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061968.965738:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7551 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965744:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7551 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965752:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9766c15c0500) 00010000:00010000:1.0:1789061968.965754:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061968.965763:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7551 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965770:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7551 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965811:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7543 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb2f expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965825:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7558 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb2f expref: 37 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.965832:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:1.0:1789061968.965834:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789061968.965837:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47be00, rc 0) 00000100:00100000:1.0:1789061968.965900:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+37:12381:x1875967120336896:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 716us (905us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789061968.965908:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 210 00000100:00100000:2.0:1789061968.969942:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061968.970018:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120337024 00000100:00100000:1.0:1789061968.970035:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120337024 00000100:00100000:1.0:1789061968.970095:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 211 00000100:00100000:1.0:1789061968.970104:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+37:12381:x1875967120337024:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:1.0:1789061968.970165:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.970180:0:10077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb13 expref: 37 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.970189:0:10077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.970234:0:10077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb13 expref: 37 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.970247:0:10077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb13 expref: 37 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061968.970261:0:10077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130877696:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061968.970369:0:10077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7840 going to sleep for 11 seconds 00000100:00100000:3.0:1789061968.973866:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061968.973978:0:10077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10077:1875967130877696:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061968.974002:0:10077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061968.974135:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120337280 00000100:00100000:0.0:1789061968.974143:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120337280 00000100:00100000:0.0:1789061968.974198:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:0.0:1789061968.974207:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:6161:x1875967120337280:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789061968.974493:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+39:6161:x1875967120337280:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 285us (633us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789061968.974501:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:2.0:1789061968.977484:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061968.977632:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120337408 00000100:00100000:0.0:1789061968.977642:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120337408 00010000:00010000:0.0:1789061968.977686:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb13 expref: 39 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061968.977725:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 94 00000100:00100000:0.0:1789061968.977735:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+39:2393:x1875967120337408:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061968.977748:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061968.977755:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb13 expref: 39 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.977769:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb13 expref: 39 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.977807:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc74fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb13 expref: 39 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.977824:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:0.0:1789061968.977829:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.977839:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.977846:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061968.977878:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061968.978036:0:10077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.978044:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.978081:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.978089:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.978094:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.978099:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613e000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061968.978104:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.978119:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.978141:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:1.0:1789061968.978144:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789061968.978148:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061968.978154:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7566 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061968.978209:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:2393:x1875967120337408:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 476us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061968.978218:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 94 00000100:00100000:1.0:1789061968.979013:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+37:12381:x1875967120337024:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 8907us (9076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061968.979023:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 211 00000100:00100000:2.0:1789061968.982121:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061968.982282:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120337664 00000100:00100000:0.0:1789061968.982468:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120337664 00000100:00100000:0.0:1789061968.982562:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:0.0:1789061968.982572:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+37:12381:x1875967120337664:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1789061968.982842:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:12381:x1875967120337664:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 271us (727us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789061968.982849:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1789061969.098546:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061969.098630:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120337920 00000100:00100000:3.0:1789061969.098641:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120337920 00000100:00100000:3.0:1789061969.098711:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 212 00000100:00100000:3.0:1789061969.098722:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+38:12392:x1875967120337920:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:3.0:1789061969.098745:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061969.098765:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc756d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb36 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.098831:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7574 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.098845:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7574 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.098856:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7574 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.098870:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc757b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.098891:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc757b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.098899:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc757b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099002:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc7582 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099011:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc7582 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099019:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc7582 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061969.099040:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789061969.099113:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7574 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099121:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7574 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099128:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7574 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099134:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807aa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061969.099138:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7574 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099145:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7574 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099166:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:3.0:1789061969.099169:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061969.099174:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7574 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099180:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7574 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099193:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc757b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099199:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc757b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099204:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc757b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099209:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061969.099212:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc757b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099217:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc757b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099223:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9766c7417800) 00010000:00010000:3.0:1789061969.099226:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061969.099229:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc757b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099234:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc757b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099283:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc756d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb36 expref: 41 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099312:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc7582 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb36 expref: 40 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.099319:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:3.0:1789061969.099321:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789061969.099323:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807b400, rc 0) 00000100:00100000:3.0:1789061969.099381:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+40:12392:x1875967120337920:12345-192.168.203.3@tcp:101:cat.0 Request processed in 661us (844us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789061969.099392:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 212 00000100:00100000:3.0:1789061969.104466:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061969.104575:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120338176 00000100:00100000:2.0:1789061969.104584:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120338176 00000100:00100000:2.0:1789061969.104669:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:2.0:1789061969.104679:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+40:12392:x1875967120338176:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:2.0:1789061969.104980:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+41:12392:x1875967120338176:12345-192.168.203.3@tcp:35:cat.0 Request processed in 302us (522us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789061969.104988:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:2.0:1789061969.129064:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.129563:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120338432 00000100:00100000:0.0:1789061969.129573:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120338432 00000100:00100000:0.0:1789061969.129690:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 213 00000100:00100000:0.0:1789061969.129713:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+41:12393:x1875967120338432:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:0.0:1789061969.129766:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789061969.129793:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7520 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb21 expref: 41 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.129815:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b400/0x2774d8f311dc7582 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb36 expref: 40 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.129827:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc7558 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb2f expref: 39 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.129838:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a800/0x2774d8f311dc7512 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb1a expref: 38 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.129848:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:0.0:1789061969.129852:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061969.129876:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc7590 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.129889:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc7590 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.129899:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc7590 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.129912:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7597 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.129919:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7597 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.129938:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7597 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.130017:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc759e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.130027:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc759e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.130035:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc759e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789061969.130219:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789061969.130229:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350239621773ns, next at 351239619753ns, rc = 0 00010000:00010000:0.0:1789061969.131132:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc75a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131147:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc75a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131156:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc75a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131165:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc75a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131171:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc75a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131177:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc75a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131252:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789061969.131273:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc759e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131279:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc759e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131285:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc759e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131290:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061969.131294:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc759e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131303:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc759e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131313:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:0.0:1789061969.131316:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789061969.131321:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc759e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131326:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc759e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131341:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc7590 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131346:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc7590 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131352:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc7590 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131363:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061969.131367:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc7590 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131372:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc7590 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131380:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:0.0:1789061969.131382:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061969.131385:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc7590 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131390:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198c00/0x2774d8f311dc7590 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789061969.131401:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076e79afd reply state 0000000081b3dc15 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7597 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131411:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7597 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.131417:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767f385ff00) 00010000:00010000:0.0:1789061969.131420:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789061969.131423:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789061969.131504:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+39:12393:x1875967120338432:12345-192.168.203.3@tcp:36:rm.0 Request processed in 1789us (2444us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789061969.131512:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 213 00010000:00010000:2.0:1789061969.132888:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061969.132906:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc75a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061969.132914:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789061969.132917:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc75a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061969.132924:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc75a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061969.132937:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:2.0:1789061969.132939:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789061969.132943:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc75a5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061969.132948:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc75a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061969.132961:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061969.132962:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061969.132963:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061969.202366:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061969.203730:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120338688 00000100:00100000:1.0:1789061969.203743:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120338688 00000100:00100000:1.0:1789061969.203818:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 214 00000100:00100000:1.0:1789061969.203828:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+39:12399:x1875967120338688:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1789061969.203853:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061969.203874:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc75ac lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb3d expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.203972:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc75b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.203989:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc75b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204000:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc75b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204024:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc75ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204033:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc75ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204040:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc75ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789061969.204337:0:10077:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789061969.204459:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc75c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204469:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc75c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204477:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc75c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204503:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc75b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204511:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc75b3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204518:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc75b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204524:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613fa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061969.204528:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc75b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204546:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc75b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204557:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:1.0:1789061969.204560:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061969.204565:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc75b3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204571:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc75b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789061969.204585:0:10077:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000342b8818 reply state 000000001229e95d transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc75ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204595:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc75ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204601:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767f385ff00) 00010000:00010000:1.0:1789061969.204603:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789061969.204794:0:10077:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789061969.204822:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc75ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb3d expref: 42 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204837:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc75c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb3d expref: 41 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.204844:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9766c15c0500) 00010000:00010000:1.0:1789061969.204847:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061969.204849:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613ec00, rc 0) 00000100:00100000:1.0:1789061969.204922:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+42:12399:x1875967120338688:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1095us (2565us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789061969.204930:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 214 00000100:00100000:3.0:1789061969.208715:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061969.208928:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120338816 00000100:00100000:2.0:1789061969.208939:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120338816 00000100:00100000:2.0:1789061969.209012:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:2.0:1789061969.209022:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2391:x1875967120338816:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1789061969.209040:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061969.209061:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c7a57dd/0x2774d8f311dc75cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb44 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789061969.209086:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789061969.209107:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1789061969.209125:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061969.209134:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c7a57dd/0x2774d8f311dc75cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb44 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061969.209155:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c7a57dd/0x2774d8f311dc75cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb44 expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061969.209169:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce000, rc 0) 00000100:00100000:2.0:1789061969.209237:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2391:x1875967120338816:12345-192.168.203.3@tcp:101:bash.0 Request processed in 215us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061969.209244:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00080000:3.0:1789061969.209471:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061969.222171:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.222265:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120338944 00000100:00100000:0.0:1789061969.222275:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120338944 00000100:00100000:0.0:1789061969.222335:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:0.0:1789061969.222359:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fb0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:12399:x1875967120338944:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1789061969.222375:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061969.222393:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb4b expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.222435:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c7a57dd/0x2774d8f311dc75cf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb44 expref: 9 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.222445:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061969.222449:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061969.222454:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 9 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.222505:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c7a57dd/0x2774d8f311dc75cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb44 expref: 9 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.222519:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c7a57dd/0x2774d8f311dc75cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb44 expref: 9 pid: 8412 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061969.222532:0:8411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8411:1875967130877824:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061969.222661:0:8411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789061969.229566:0:8411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8411:1875967130877824:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061969.229600:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 9 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.229684:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198c00, rc 0) 00000100:00100000:0.0:1789061969.229740:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fb0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:12399:x1875967120338944:12345-192.168.203.3@tcp:101:bash.0 Request processed in 7383us (7577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061969.229750:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:3.0:1789061969.234341:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.234446:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120339072 00000100:00100000:0.0:1789061969.234456:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120339072 00010000:00010000:0.0:1789061969.234497:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c7a57dd/0x2774d8f311dc75cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb44 expref: 9 pid: 8412 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061969.234540:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:0.0:1789061969.234550:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c629b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2392:x1875967120339072:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061969.234565:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061969.234586:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c7a57dd/0x2774d8f311dc75cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb44 expref: 9 pid: 8412 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.234600:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c7a57dd/0x2774d8f311dc75cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb44 expref: 9 pid: 8412 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.234657:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c7a57dd/0x2774d8f311dc75cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb44 expref: 9 pid: 8412 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.234676:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061969.234680:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061969.234688:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.234715:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.234753:0:6482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061969.234869:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6482:1875967130877952:192.168.203.3@tcp:105: 00000100:00100000:0.0:1789061969.234998:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789061969.247639:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.247775:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6482:1875967130877952:192.168.203.3@tcp:105: 00010000:00010000:0.0:1789061969.247802:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061969.247861:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c629b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120339072:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 13312us (13527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061969.247873:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 95 00000100:00100000:3.0:1789061969.248109:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120339328 00000100:00100000:3.0:1789061969.248116:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120339328 00000100:00100000:3.0:1789061969.248211:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:3.0:1789061969.248221:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+42:12399:x1875967120339328:12345-192.168.203.3@tcp:35:bash.0 00000001:00080000:3.0:1789061969.248434:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967485 00000100:00100000:3.0:1789061969.248519:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+44:12399:x1875967120339328:12345-192.168.203.3@tcp:35:bash.0 Request processed in 300us (914us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789061969.248526:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000020:00080000:3.0:1789061969.248530:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789061969.451819:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061969.453816:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120339456 00000100:00100000:1.0:1789061969.453829:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120339456 00000100:00100000:1.0:1789061969.453904:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 215 00000100:00100000:1.0:1789061969.453915:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+44:12415:x1875967120339456:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061969.453937:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061969.453957:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc75dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb52 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.454029:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc75e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.454043:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc75e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.454054:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc75e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061969.454093:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789061969.454098:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061969.454117:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc75e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.454139:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc75dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb52 expref: 46 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.454157:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc75e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb52 expref: 45 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.454183:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:1.0:1789061969.454187:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789061969.454190:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613f200, rc 0) 00000100:00100000:1.0:1789061969.454259:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+45:12415:x1875967120339456:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 345us (2448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061969.454265:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 215 00000100:00100000:1.0:1789061969.469637:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.469795:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120339712 00000100:00100000:0.0:1789061969.469804:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120339712 00000100:00100000:0.0:1789061969.469859:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 216 00000100:00100000:0.0:1789061969.469869:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+45:12415:x1875967120339712:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061969.469888:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061969.469907:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc75eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb59 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.470015:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc75f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.470040:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc75f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.470066:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc75f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061969.470078:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789061969.470184:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc75eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb59 expref: 48 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.470202:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc75f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb59 expref: 47 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.470211:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9766c15c0500) 00010000:00010000:0.0:1789061969.470214:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061969.470217:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198000, rc 0) 00000100:00100000:0.0:1789061969.470278:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+47:12415:x1875967120339712:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 410us (675us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1789061969.470286:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 216 00000100:00100000:2.0:1789061969.479030:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061969.479078:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061969.479171:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120340096 00000100:00100000:3.0:1789061969.479179:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120340096 00000100:00100000:3.0:1789061969.479252:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1789061969.479262:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+47:2391:x1875967120340096:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061969.479276:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061969.479298:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc75f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb59 expref: 47 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.479316:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9766c15c0500) 00010000:00010000:3.0:1789061969.479321:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061969.479361:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120339968 00000100:00100000:1.0:1789061969.479368:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120339968 00000100:00100000:3.0:1789061969.479378:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+47:2391:x1875967120340096:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 117us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061969.479388:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1789061969.479406:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 217 00000100:00100000:1.0:1789061969.479415:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+46:12415:x1875967120339968:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061969.479434:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061969.479453:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc7600 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb60 expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.479556:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc7607 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.479570:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc7607 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.479579:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc7607 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061969.479588:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789061969.479724:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc7600 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb60 expref: 49 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.479761:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc7607 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb60 expref: 48 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.479770:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9766c15c0500) 00010000:00010000:1.0:1789061969.479773:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789061969.479776:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613fa00, rc 0) 00000100:00100000:1.0:1789061969.479805:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+48:12415:x1875967120339968:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 392us (727us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1789061969.479812:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 217 00000100:00100000:2.0:1789061969.506691:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.506786:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120340224 00000100:00100000:0.0:1789061969.506796:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120340224 00000100:00100000:0.0:1789061969.506851:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:0.0:1789061969.506861:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120340224:12345-192.168.203.3@tcp:1:lfs.0 00010000:00010000:0.0:1789061969.506903:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.506925:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.506933:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061969.506949:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789061969.506954:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.506986:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.507000:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 8 pid: 8411 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061969.507013:0:8412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8412:1875967130878080:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061969.507111:0:8412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789061969.520491:0:8412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8412:1875967130878080:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061969.520527:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061969.522716:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061969.522800:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120340352 00000100:00100000:3.0:1789061969.522810:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120340352 00002000:00100000:3.0:1789061969.522858:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9766c83a6a00 x1875967120340352/t0(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:390/0 lens 504/0 e 0 to 0 dl 1789061980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789061969.522869:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c83a6a00 with x1875967120340352 ext(0->8) 00010000:00010000:3.0:1789061969.522877:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 9 pid: 8411 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.522892:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 9 pid: 8411 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061969.522901:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9766c83a6a00 00000100:00100000:3.0:1789061969.522933:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:3.0:1789061969.522942:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2392:x1875967120340352:12345-192.168.203.3@tcp:4:lfs.0 00000100:00100000:3.0:1789061969.531021:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:2392:x1875967120340352:12345-192.168.203.3@tcp:4:lfs.0 Request processed in 8070us (8302us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789061969.531035:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00002000:00100000:3.0:1789061969.531049:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9766c83a6a00 x1875967120340352/t4294967309(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:390/0 lens 504/448 e 0 to 0 dl 1789061980 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789061969.531060:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c83a6a00 with x1875967120340352 ext(0->8) 00010000:00010000:3.0:1789061969.531070:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 11 pid: 8411 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.531090:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 11 pid: 8411 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061969.531099:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9766c83a6a00 00000001:00080000:1.0:1789061969.535652:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1789061969.535671:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1789061969.541224:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061969.541391:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120340480 00000100:00100000:3.0:1789061969.541401:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120340480 00010000:00010000:3.0:1789061969.541441:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 7 pid: 8411 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061969.541486:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 96 00000100:00100000:3.0:1789061969.541496:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2391:x1875967120340480:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061969.541511:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789061969.541529:0:6481:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789061969.541532:0:6481:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789061968 00002000:00010000:3.0:1789061969.541534:0:6481:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789061968 00002000:00010000:3.0:1789061969.541536:0:6481:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789061968 00002000:00010000:3.0:1789061969.541552:0:6481:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789061969.541560:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 7 pid: 8411 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.541574:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 7 pid: 8411 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.541598:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045854461/0x2774d8f311dc75d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb4b expref: 7 pid: 8411 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.541772:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061969.541778:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061969.541784:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.541794:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061969.541884:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061969.541938:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+6:2391:x1875967120340480:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 442us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061969.541946:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 96 00010000:00010000:0.0:1789061969.542012:0:8412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.542022:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.542042:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.542049:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.542064:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.542085:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199200 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789061969.542089:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.542098:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.542111:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.542117:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7615 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061969.542166:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2393:x1875967120340224:12345-192.168.203.3@tcp:1:lfs.0 Request processed in 35307us (35483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061969.542173:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:2.0:1789061969.554252:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.555870:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120340736 00000100:00100000:0.0:1789061969.555883:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120340736 00000100:00100000:0.0:1789061969.556006:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:0.0:1789061969.556017:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f06c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+48:12415:x1875967120340736:12345-192.168.203.3@tcp:35:lfs.0 00000004:00010000:0.0:1789061969.556098:0:6499:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc7607 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb60 expref: 48 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061969.556277:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789061969.556307:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1789061969.556570:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:0.0:1789061969.556604:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.556636:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc75c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb3d expref: 52 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.556656:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.556688:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc75c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb3d expref: 52 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.556701:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc75c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb3d expref: 52 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061969.556713:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1875967130878208:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061969.560599:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789061969.563850:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.566269:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1875967130878208:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061969.566301:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061969.566423:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120340864 00000100:00100000:1.0:1789061969.566430:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120340864 00010000:00010000:1.0:1789061969.566467:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc75c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb3d expref: 53 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061969.566510:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 97 00000100:00100000:1.0:1789061969.566520:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c82a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+53:2392:x1875967120340864:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061969.566546:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061969.566554:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc75c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb3d expref: 53 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.566567:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc75c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb3d expref: 53 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.566590:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc75c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb3d expref: 53 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.566660:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9766c15c0500) 00010000:00010000:1.0:1789061969.566665:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.566675:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.566683:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.566717:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789061969.567010:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.567029:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061969.567159:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:3.0:1789061969.567270:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1789061969.567376:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1875967130878336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789061969.567452:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061969.567488:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789061969.567556:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130878336 00000100:00100000:2.0:1789061969.567561:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130878336 00000100:00100000:2.0:1789061969.567600:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789061969.567633:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1875967130878336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789061969.567726:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1875967130878336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 96us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061969.567734:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789061969.568007:0:6499:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1789061969.568013:0:6499:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1789061969.568029:0:6499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9767c3066680, transno 4294967308 00000100:00100000:3.0:1789061969.568043:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1875967130878336:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789061969.568146:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:3.0:1789061969.568188:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1875967130878464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789061969.568215:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061969.568230:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6750300 going to sleep for 11 seconds 00000100:00100000:1.0:1789061969.569285:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c82a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+55:2392:x1875967120340864:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2761us (5438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061969.569295:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 97 00000100:00100000:0.0:1789061969.569889:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130878464 00000100:00100000:0.0:1789061969.569897:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130878464 00000100:00100000:0.0:1789061969.569941:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789061969.569949:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6499:x1875967130878464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789061969.570152:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6499:x1875967130878464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 203us (1935us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789061969.570159:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789061969.570888:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1875967130878464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789061969.570951:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1789061969.570993:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.571003:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.571011:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.571028:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061969.571033:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.571054:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.571154:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9766c15c0500) 00010000:00010000:1.0:1789061969.571158:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789061969.571163:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.571170:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc761c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789061969.571274:0:6499:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789061969.571332:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1789061969.571343:0:6499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350680735890ns, next at 351680733445ns, rc = 0 00000001:00080000:1.0:1789061969.571349:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1789061969.571372:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9766c15c0500) 00010000:00010000:1.0:1789061969.571375:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789061969.571381:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc7607 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb60 expref: 56 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061969.572244:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f06c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+55:12415:x1875967120340736:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 16225us (17997us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789061969.572254:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000020:00080000:1.0:1789061969.572259:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789061969.575147:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.575261:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120340992 00000100:00100000:0.0:1789061969.575270:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120340992 00000100:00100000:0.0:1789061969.575327:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 218 00000100:00100000:0.0:1789061969.575338:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+55:12415:x1875967120340992:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061969.575360:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061969.575382:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc7623 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb67 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.575941:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc7623 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb67 expref: 56 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.575957:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc7623 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb67 expref: 56 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.575978:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:0.0:1789061969.575981:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789061969.575984:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198200, rc 0) 00000100:00100000:0.0:1789061969.576045:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+56:12415:x1875967120340992:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 709us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061969.576052:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 218 00000100:00100000:2.0:1789061969.581109:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061969.581281:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120341248 00000100:00100000:3.0:1789061969.581290:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120341248 00000100:00100000:3.0:1789061969.581349:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:3.0:1789061969.581359:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+56:12415:x1875967120341248:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:0.0:1789061969.582450:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+57:12415:x1875967120341248:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 1087us (1342us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789061969.582461:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:2.0:1789061969.685062:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061969.685205:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120341376 00000100:00100000:3.0:1789061969.685215:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120341376 00000100:00100000:3.0:1789061969.685281:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 219 00000100:00100000:3.0:1789061969.685292:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+57:12425:x1875967120341376:12345-192.168.203.3@tcp:34:lfs.0 00010000:00010000:3.0:1789061969.685366:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc762a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685383:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc762a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685395:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc762a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685426:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7631 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685434:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7631 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685441:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7631 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685510:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7638 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685519:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685526:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789061969.685582:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685595:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc762a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685602:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc762a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685654:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc762a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685660:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807be00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061969.685664:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc762a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685678:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc762a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685690:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:3.0:1789061969.685693:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061969.685697:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc762a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685703:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807be00/0x2774d8f311dc762a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685716:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7631 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685722:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7631 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685729:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7631 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685736:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061969.685739:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7631 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685746:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7631 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685753:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767f385ff00) 00010000:00010000:3.0:1789061969.685756:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061969.685759:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7631 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685775:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7631 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685785:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685790:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7638 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685796:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7638 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685801:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807aa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061969.685804:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7638 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685810:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7638 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685817:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:3.0:1789061969.685826:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061969.685830:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7638 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.685836:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7638 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061969.686013:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+57:12425:x1875967120341376:12345-192.168.203.3@tcp:34:lfs.0 Request processed in 722us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061969.686030:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 219 00010000:00010000:0.0:1789061969.708337:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061969.752723:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061969.752817:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120341632 00000100:00100000:1.0:1789061969.752828:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120341632 00000100:00100000:1.0:1789061969.752899:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 220 00000100:00100000:1.0:1789061969.752909:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+57:12428:x1875967120341632:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061969.752943:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061969.752964:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc763f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb6e expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753042:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc7646 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753058:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc7646 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753069:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc7646 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753080:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc764d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753087:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc764d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753099:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc764d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753197:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc7654 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753206:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc7654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753213:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc7654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061969.753223:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789061969.753302:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc7646 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753311:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc7646 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753318:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc7646 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753324:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613e800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061969.753328:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc7646 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753336:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc7646 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753349:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:1.0:1789061969.753352:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061969.753356:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc7646 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753363:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc7646 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753376:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc764d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753382:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc764d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753389:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc764d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753405:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613e000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061969.753408:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc764d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753415:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc764d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753423:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767f385ff00) 00010000:00010000:1.0:1789061969.753426:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061969.753429:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc764d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753435:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc764d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753472:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc763f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb6e expref: 60 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753487:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc7654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb6e expref: 59 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.753495:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061969.753498:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061969.753500:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613f400, rc 0) 00000100:00100000:1.0:1789061969.753939:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:12428:x1875967120341632:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1029us (1223us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789061969.753947:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 220 00000100:00100000:1.0:1789061969.771774:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.772151:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120341760 00000100:00100000:0.0:1789061969.772160:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120341760 00000100:00100000:0.0:1789061969.772218:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 221 00000100:00100000:0.0:1789061969.772228:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:12428:x1875967120341760:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1789061969.772289:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7662 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.772306:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.772317:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.772350:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.772358:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7662 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.772364:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7662 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.772370:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061969.772374:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7662 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.772381:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7662 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.772392:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:0.0:1789061969.772395:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789061969.772408:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7662 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.772414:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7662 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061969.772485:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:12428:x1875967120341760:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 258us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061969.772493:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 221 00000100:00100000:2.0:1789061969.775550:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061969.775679:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120342016 00000100:00100000:1.0:1789061969.775688:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120342016 00000100:00100000:1.0:1789061969.775762:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:1.0:1789061969.775771:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+59:12428:x1875967120342016:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:1.0:1789061969.776088:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:12428:x1875967120342016:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 317us (545us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789061969.776096:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:2.0:1789061969.856256:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.856354:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120342272 00000100:00100000:0.0:1789061969.856364:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120342272 00000100:00100000:0.0:1789061969.856428:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 222 00000100:00100000:0.0:1789061969.856437:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:12438:x1875967120342272:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1789061969.856461:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061969.856464:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789061969.856491:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc75e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb52 expref: 60 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.856511:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:0.0:1789061969.856515:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789061969.856543:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7669 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb75 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.856698:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.856711:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc7654 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb6e expref: 60 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.856718:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.856761:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc7654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb6e expref: 60 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.856772:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc7654 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb6e expref: 60 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061969.856785:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130878592:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061969.856875:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789061969.859707:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130878592:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061969.859735:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061969.861437:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061969.861504:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120342400 00000100:00100000:3.0:1789061969.861512:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120342400 00010000:00010000:3.0:1789061969.861563:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc7654 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb6e expref: 61 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061969.861647:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 98 00000100:00100000:3.0:1789061969.861658:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:2393:x1875967120342400:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061969.861673:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061969.861680:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc7654 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb6e expref: 61 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.861693:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc7654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb6e expref: 61 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.861714:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc7654 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb6e expref: 61 pid: 10077 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.861729:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:3.0:1789061969.861735:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.861743:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.861750:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061969.861781:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061969.861832:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:2393:x1875967120342400:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 176us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061969.861840:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 98 00010000:00010000:0.0:1789061969.862067:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.862077:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061969.862094:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789061969.862217:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7669 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb75 expref: 61 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.862234:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb75 expref: 60 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.862240:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:0.0:1789061969.862243:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789061969.862253:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199800, rc 0) 00000100:00100000:0.0:1789061969.862289:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:12438:x1875967120342272:12345-192.168.203.3@tcp:101:bash.0 Request processed in 5853us (6043us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1789061969.862296:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 222 00000100:00100000:2.0:1789061969.865308:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061969.865373:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120342528 00000100:00100000:1.0:1789061969.865382:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120342528 00000100:00100000:1.0:1789061969.865472:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 223 00000100:00100000:1.0:1789061969.865484:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+60:12438:x1875967120342528:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1789061969.865505:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061969.865534:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc767e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb7c expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.865569:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7685 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.865585:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.865595:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.865751:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc767e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb7c expref: 62 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.865770:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7685 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb7c expref: 61 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.865791:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061969.865795:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789061969.865798:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613e000, rc 0) 00000100:00100000:1.0:1789061969.865856:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:12438:x1875967120342528:12345-192.168.203.3@tcp:101:bash.0 Request processed in 375us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061969.865863:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 223 00000100:00100000:2.0:1789061969.875196:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061969.875262:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120342784 00000100:00100000:1.0:1789061969.875272:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120342784 00000100:00100000:1.0:1789061969.875334:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 224 00000100:00100000:1.0:1789061969.875345:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+61:12438:x1875967120342784:12345-192.168.203.3@tcp:36:bash.0 00010000:00010000:1.0:1789061969.875558:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc768c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.875575:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc768c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.875587:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc768c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789061969.875861:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:1.0:1789061969.875886:0:6498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000728e7618 reply state 000000009c0aa6ea transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc768c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.875901:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc768c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.875908:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061969.875911:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789061969.875927:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789061969.876021:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+64:12438:x1875967120342784:12345-192.168.203.3@tcp:36:bash.0 Request processed in 676us (832us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789061969.876028:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 224 00000020:00080000:1.0:1789061969.876033:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789061969.878383:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.879506:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120342912 00000100:00100000:0.0:1789061969.879517:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120342912 00000100:00100000:0.0:1789061969.879583:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 225 00000100:00100000:0.0:1789061969.879593:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+64:12438:x1875967120342912:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:0.0:1789061969.879657:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061969.879678:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7693 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb83 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.879783:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.879797:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb75 expref: 65 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.879806:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.880499:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb75 expref: 65 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.880517:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb75 expref: 65 pid: 8435 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061969.880532:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130878720:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061969.880806:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789061969.883914:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130878720:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061969.883944:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061969.884007:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.884297:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120343040 00000100:00100000:0.0:1789061969.884304:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120343040 00010000:00010000:0.0:1789061969.884336:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb75 expref: 66 pid: 8435 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061969.884375:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 99 00000100:00100000:0.0:1789061969.884384:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+66:2392:x1875967120343040:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061969.884397:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061969.884404:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb75 expref: 66 pid: 8435 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.884426:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb75 expref: 66 pid: 8435 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.884446:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7670 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb75 expref: 66 pid: 8435 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.884463:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:0.0:1789061969.884467:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.884476:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.884483:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.884525:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061969.884660:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+65:2392:x1875967120343040:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 275us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061969.884668:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 99 00010000:00010000:2.0:1789061969.884795:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061969.884803:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061969.884865:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789061969.884870:0:8435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061969.884890:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061969.884921:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199c00/0x2774d8f311dc7693 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb83 expref: 65 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061969.884947:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb83 expref: 64 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061969.884956:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:2.0:1789061969.884958:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789061969.884961:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199000, rc 0) 00000100:00100000:2.0:1789061969.884989:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+64:12438:x1875967120342912:12345-192.168.203.3@tcp:101:bash.0 Request processed in 5397us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061969.884996:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 225 00000100:00100000:2.0:1789061969.893938:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.900101:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120343296 00000100:00100000:0.0:1789061969.900115:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120343296 00000100:00100000:0.0:1789061969.900177:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1789061969.900185:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+64:12438:x1875967120343296:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:0.0:1789061969.900579:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+65:12438:x1875967120343296:12345-192.168.203.3@tcp:35:bash.0 Request processed in 392us (6649us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1789061969.900587:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:3.0:1789061969.971195:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061969.972556:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120343424 00000100:00100000:1.0:1789061969.972567:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120343424 00000100:00100000:1.0:1789061969.972681:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 226 00000100:00100000:1.0:1789061969.972692:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+65:12444:x1875967120343424:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061969.972716:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061969.972737:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc76a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb8a expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.972801:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc76a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.972815:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc76a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.972828:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc76a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061969.972872:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789061969.972876:0:10077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061969.972893:0:10077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc76a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.972917:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e800/0x2774d8f311dc76a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb8a expref: 67 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.972939:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc76a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb8a expref: 66 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.972959:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:1.0:1789061969.972962:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789061969.972966:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767d613f400, rc 0) 00000100:00100000:1.0:1789061969.973028:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+66:12444:x1875967120343424:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 338us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061969.973035:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 226 00000100:00100000:2.0:1789061969.976968:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061969.977077:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120343552 00000100:00100000:1.0:1789061969.977086:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120343552 00000100:00100000:1.0:1789061969.977143:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 227 00000100:00100000:1.0:1789061969.977152:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+66:12444:x1875967120343552:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061969.977171:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061969.977190:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc76af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb91 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977269:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc76b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977283:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc76b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977304:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc76b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977316:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977324:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977341:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977408:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977417:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977425:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061969.977464:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789061969.977468:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061969.977484:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977496:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977503:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc76b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977510:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc76b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977517:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc76b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977523:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613fa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061969.977527:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc76b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977550:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc76b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977562:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:1.0:1789061969.977565:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061969.977570:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc76b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977576:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fa00/0x2774d8f311dc76b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977592:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977598:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977624:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977630:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47be00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061969.977633:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977650:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977658:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767f385ff00) 00010000:00010000:1.0:1789061969.977660:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061969.977662:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977679:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977704:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f200/0x2774d8f311dc76af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb91 expref: 68 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977719:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb91 expref: 67 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.977726:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061969.977728:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061969.977730:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47ba00, rc 0) 00000100:00100000:1.0:1789061969.977837:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:12444:x1875967120343552:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 685us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061969.977845:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 227 00000100:00100000:2.0:1789061969.988925:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.990234:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120343808 00000100:00100000:0.0:1789061969.990246:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120343808 00000100:00100000:0.0:1789061969.990302:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 228 00000100:00100000:0.0:1789061969.990312:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:12444:x1875967120343808:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061969.990332:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061969.990352:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc76cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb98 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.990462:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.990476:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb83 expref: 68 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.990482:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb91 expref: 68 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.990513:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.990546:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb91 expref: 68 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.990558:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb91 expref: 68 pid: 6498 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061969.990571:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130878848:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789061969.991213:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb83 expref: 68 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061969.991225:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb83 expref: 68 pid: 8435 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061969.991237:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130878976:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061969.991444:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061969.991792:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789061969.992263:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120343936 00000100:00100000:1.0:1789061969.992271:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120343936 00010000:00010000:1.0:1789061969.992302:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb91 expref: 69 pid: 6498 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061969.992397:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 100 00000100:00100000:1.0:1789061969.992406:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+69:2390:x1875967120343936:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061969.992418:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061969.992424:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb91 expref: 69 pid: 6498 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.992453:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb91 expref: 69 pid: 6498 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.992471:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061969.992476:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.992484:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061969.992490:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061969.992541:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+69:2390:x1875967120343936:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 137us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061969.992548:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 100 00000100:00100000:3.0:1789061970.009030:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061970.011230:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130878976:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061970.013189:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120344064 00000100:00100000:2.0:1789061970.013203:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120344064 00010000:00010000:3.0:1789061970.013348:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb83 expref: 69 pid: 8435 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061970.013392:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 101 00000100:00100000:3.0:1789061970.013405:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c629a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+69:2393:x1875967120344064:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061970.013419:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061970.013426:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb83 expref: 69 pid: 8435 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.013439:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb83 expref: 69 pid: 8435 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.013460:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199000/0x2774d8f311dc769a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb83 expref: 69 pid: 8435 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.013476:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:3.0:1789061970.013481:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.013489:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.013496:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.013513:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061970.013732:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c629a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:2393:x1875967120344064:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 330us (4722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061970.013756:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 101 00000100:00080000:2.0:1789061970.013845:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789061970.015229:0:8435:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.3@tcp) returned -22 from blocking AST (req@000000005fa1a4a6 x1875967130878848) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb91 expref: 67 pid: 6498 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.015249:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb91 expref: 67 pid: 6498 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061970.015266:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8435:1875967130878848:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061970.015290:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061970.015297:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.015306:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.015323:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061970.015344:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789061970.015463:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc76cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb98 expref: 68 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.015477:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb98 expref: 67 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.015484:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061970.015487:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789061970.015489:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199400, rc 0) 00000100:00100000:1.0:1789061970.015552:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:12444:x1875967120343808:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 25241us (26635us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789061970.015560:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 228 00000100:00100000:3.0:1789061970.018804:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061970.021776:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120344320 00000100:00100000:0.0:1789061970.021791:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120344320 00000100:00100000:0.0:1789061970.021931:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:0.0:1789061970.021946:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:12444:x1875967120344320:12345-192.168.203.3@tcp:103:lfs.0 00010000:00010000:0.0:1789061970.021966:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061970.021996:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198200/0x2774d8f311dc7623 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb67 expref: 67 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061970.022676:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:0.0:1789061970.022683:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061970.022753:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+66:12444:x1875967120344320:12345-192.168.203.3@tcp:103:lfs.0 Request processed in 811us (3956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061970.022761:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1789061970.028110:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061970.028241:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120344448 00000100:00100000:1.0:1789061970.028251:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120344448 00000100:00100000:1.0:1789061970.028307:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 229 00000100:00100000:1.0:1789061970.028318:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+66:12444:x1875967120344448:12345-192.168.203.3@tcp:58:lfs.0 00010000:00010000:1.0:1789061970.028446:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.028462:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.028474:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789061970.028590:0:10077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789061970.029058:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+66:12444:x1875967120344448:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 740us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061970.029066:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 229 00000100:00100000:3.0:1789061970.031681:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061970.031969:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120344576 00000100:00100000:1.0:1789061970.031978:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120344576 00000100:00100000:1.0:1789061970.032044:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 230 00000100:00100000:1.0:1789061970.032056:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+66:12444:x1875967120344576:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789061970.032073:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061970.032093:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc76e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bb9f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.032143:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76e0 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.032153:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc76e7 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb9f expref: 67 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.032170:0:6496:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.032180:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc76e7 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb9f expref: 67 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.032192:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061970.032194:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061970.032198:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc76e7 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb9f expref: 67 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.032217:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a000, rc 0) 00000100:00100000:1.0:1789061970.032278:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:12444:x1875967120344576:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 225us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061970.032286:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 230 00010000:00010000:0.0:1789061970.729840:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789061970.857856:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061970.857866:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061970.857891:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789061970.857903:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061970.858169:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13772:1875967130879104:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789061970.858282:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789061970.864917:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061970.865018:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120344704 00000100:00100000:2.0:1789061970.865028:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120344704 00000100:00100000:2.0:1789061970.865093:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 231 00000100:00100000:2.0:1789061970.865103:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:12445:x1875967120344704:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789061970.865134:0:8435:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789061970.865241:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:12445:x1875967120344704:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 139us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061970.865249:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 231 00000100:00100000:1.0:1789061970.865696:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13772:1875967130879104:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789061970.888471:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061970.888857:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120344832 00000100:00100000:1.0:1789061970.888866:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120344832 00000100:00100000:1.0:1789061970.888927:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 232 00000100:00100000:1.0:1789061970.888937:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:12445:x1875967120344832:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789061970.889003:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76ee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889032:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889043:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889271:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc76f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889298:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc76f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889307:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc76f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889333:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc76fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889342:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc76fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889348:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc76fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061970.889393:0:10077:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789061970.889398:0:10077:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789061970.889410:0:10077:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc76fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889420:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889427:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76ee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889434:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889440:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ba00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061970.889445:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889459:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76ee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889471:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c7417500) 00010000:00010000:1.0:1789061970.889474:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061970.889479:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889485:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc76ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889499:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc76f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889505:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc76f5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889511:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc76f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889517:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061970.889520:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc76f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889753:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc76f5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889761:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9766c15c0500) 00010000:00010000:1.0:1789061970.889764:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061970.889767:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc76f5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889783:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc76f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889798:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc76fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889803:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc76fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889808:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc76fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889813:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061970.889816:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc76fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889821:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc76fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889829:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061970.889831:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061970.889833:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc76fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.889838:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc76fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061970.889986:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:12445:x1875967120344832:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 1049us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061970.889994:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 232 00000100:00100000:0.0:1789061970.895033:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061970.895117:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120345088 00000100:00100000:3.0:1789061970.895126:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120345088 00000100:00100000:3.0:1789061970.895187:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 233 00000100:00100000:3.0:1789061970.895202:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+67:12445:x1875967120345088:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061970.895221:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061970.895239:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7703 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bba6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.895337:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc770a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.895352:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc770a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.895364:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc770a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789061970.895375:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789061970.895446:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc770a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.895453:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc770a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.895476:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc770a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.895482:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061970.895487:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc770a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.895494:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc770a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.895505:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:3.0:1789061970.895508:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789061970.895513:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc770a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.895518:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc770a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.895571:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7703 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bba6 expref: 69 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.895582:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c7417500) 00010000:00010000:3.0:1789061970.895585:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789061970.895588:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7703 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bba6 expref: 69 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.895598:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807aa00, rc 0) 00000100:00100000:3.0:1789061970.895695:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:12445:x1875967120345088:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 499us (672us total) trans 4294967506 rc 301/301 00000100:00100000:3.0:1789061970.895712:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 233 00000100:00100000:0.0:1789061970.900301:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061970.900350:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120345216 00000100:00100000:3.0:1789061970.900359:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120345216 00000100:00100000:3.0:1789061970.900420:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 234 00000100:00100000:3.0:1789061970.900430:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:12445:x1875967120345216:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789061970.900467:0:6498:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789061970.900576:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:12445:x1875967120345216:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 146us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061970.900583:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 234 00000100:00100000:0.0:1789061970.904110:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061970.904205:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120345472 00000100:00100000:1.0:1789061970.904214:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120345472 00000100:00100000:1.0:1789061970.904265:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 235 00000100:00100000:1.0:1789061970.904276:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:12445:x1875967120345472:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061970.904294:0:10077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061970.904298:0:10077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789061970.904321:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613f400/0x2774d8f311dc76a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb8a expref: 68 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.904341:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:1.0:1789061970.904346:0:10077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061970.904359:0:10077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7718 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bbad expref: -99 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789061970.904774:0:10077:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1789061970.904901:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc771f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.904914:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc771f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.904924:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc771f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.904972:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7718 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbad expref: 70 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.904986:0:10077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc771f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbad expref: 69 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.905011:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c15c0500) 00010000:00010000:1.0:1789061970.905014:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061970.905017:0:10077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b800, rc 0) 00000100:00100000:1.0:1789061970.905077:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+69:12445:x1875967120345472:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 803us (977us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789061970.905085:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 235 00000100:00100000:0.0:1789061970.909411:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061970.909911:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120345728 00000100:00100000:2.0:1789061970.909922:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120345728 00000100:00100000:2.0:1789061970.909993:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 236 00000100:00100000:2.0:1789061970.910002:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+69:12445:x1875967120345728:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789061970.910052:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061970.910077:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc771f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbad expref: 69 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910094:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c15c0500) 00010000:00010000:2.0:1789061970.910105:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061970.910124:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc772d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910138:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc772d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910148:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc772d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910163:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7734 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xcb8e4233 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910169:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcb8e4233 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910174:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcb8e4233 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910223:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc772d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910229:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc772d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910244:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc772d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910250:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cee00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061970.910254:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc772d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910260:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc772d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910267:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:2.0:1789061970.910270:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061970.910274:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc772d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910279:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc772d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910289:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcb8e4233 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910295:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7734 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcb8e4233 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910301:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7734 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcb8e4233 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910306:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789061970.910308:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7734 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcb8e4233 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910324:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7734 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcb8e4233 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910332:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xcb8e4233 (ffff9767fd592c00) 00010000:00010000:2.0:1789061970.910335:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789061970.910338:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7734 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xcb8e4233 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.910344:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7734 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xcb8e4233 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061970.910408:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:12445:x1875967120345728:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 407us (1006us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789061970.910414:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 236 00000100:00100000:0.0:1789061970.918922:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061970.919042:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120345856 00000100:00100000:3.0:1789061970.919051:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120345856 00000100:00100000:3.0:1789061970.919139:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 237 00000100:00100000:3.0:1789061970.919149:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+68:12445:x1875967120345856:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061970.919169:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061970.919203:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc773b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bbb4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.919238:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7742 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.919251:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.919262:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7742 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.919367:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc773b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbb4 expref: 70 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.919391:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7742 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbb4 expref: 69 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.919400:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:3.0:1789061970.919403:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789061970.919406:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807a000, rc 0) 00000100:00100000:3.0:1789061970.919469:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+69:12445:x1875967120345856:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 320us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061970.919476:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 237 00000100:00100000:0.0:1789061970.930254:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061970.930323:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120346112 00000100:00100000:3.0:1789061970.930333:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120346112 00000100:00100000:3.0:1789061970.930397:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 238 00000100:00100000:3.0:1789061970.930408:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+69:12445:x1875967120346112:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789061970.930487:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7749 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.930503:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7749 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.930514:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7749 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789061970.930720:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1789061970.930731:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352040124415ns, next at 353040121696ns, rc = 0 00000004:00010000:3.0:1789061970.930776:0:6497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000174e15f7 reply state 00000000b5fcbc97 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7749 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.930808:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7749 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.930816:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:3.0:1789061970.930818:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789061970.930822:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789061970.930906:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+71:12445:x1875967120346112:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 499us (661us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789061970.930913:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 238 00000100:00100000:0.0:1789061970.934070:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061970.935386:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120346240 00000100:00100000:1.0:1789061970.935399:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120346240 00000100:00100000:1.0:1789061970.935467:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 239 00000100:00100000:1.0:1789061970.935478:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f3873c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+71:12445:x1875967120346240:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061970.935501:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061970.935522:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7750 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bbbb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.935577:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7750 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbbb expref: 72 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.935593:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7750 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbbb expref: 72 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.935854:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:1.0:1789061970.935858:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061970.935862:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a200, rc 0) 00000100:00100000:1.0:1789061970.935914:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f3873c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+72:12445:x1875967120346240:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 438us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061970.935937:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 239 00000100:00100000:0.0:1789061970.940204:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061970.940301:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120346368 00000100:00100000:2.0:1789061970.940311:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120346368 00000100:00100000:2.0:1789061970.940377:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:2.0:1789061970.940387:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2392:x1875967120346368:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789061970.940591:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:2392:x1875967120346368:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 205us (394us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789061970.940599:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00080000:3.0:1789061970.940829:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789061970.945138:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061970.945649:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120346624 00000100:00100000:2.0:1789061970.945658:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120346624 00000100:00100000:2.0:1789061970.945718:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:2.0:1789061970.945729:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+72:12445:x1875967120346624:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789061970.945940:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+73:12445:x1875967120346624:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 212us (811us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789061970.945970:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:1.0:1789061970.949432:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061970.949506:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120346880 00000100:00100000:3.0:1789061970.949516:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120346880 00000100:00100000:3.0:1789061970.949586:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 240 00000100:00100000:3.0:1789061970.949596:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+73:12445:x1875967120346880:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789061970.949753:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+73:12445:x1875967120346880:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 158us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061970.949760:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 240 00000100:00100000:0.0:1789061970.952712:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061970.952880:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120347008 00000100:00100000:2.0:1789061970.952890:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120347008 00000100:00100000:2.0:1789061970.952944:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:2.0:1789061970.952961:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+73:12445:x1875967120347008:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789061970.952980:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789061970.953000:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7757 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bbc2 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.953074:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc775e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.953090:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc775e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.953103:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc775e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789061970.953142:0:8435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789061970.953160:0:8435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc775e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.953184:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7757 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbc2 expref: 75 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.953203:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc775e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbc2 expref: 74 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.953211:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:2.0:1789061970.953227:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789061970.953232:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cee00, rc 0) 00000100:00100000:2.0:1789061970.953519:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+74:12445:x1875967120347008:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 338us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061970.953535:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 241 00000100:00100000:1.0:1789061970.956460:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061970.956761:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120347136 00000100:00100000:3.0:1789061970.956770:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120347136 00000100:00100000:3.0:1789061970.956830:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:3.0:1789061970.956840:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+10:2393:x1875967120347136:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789061970.956857:0:8613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061970.956878:0:8613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a9b4c5a/0x2774d8f311dc7765 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bbc9 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789061970.956901:0:8613:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2eb51, blocks: 0x0 00010000:00010000:3.0:1789061970.956937:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1789061970.956942:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061970.956951:0:8613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a9b4c5a/0x2774d8f311dc7765 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbc9 expref: 11 pid: 8613 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.956971:0:8613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a9b4c5a/0x2774d8f311dc7765 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbc9 expref: 11 pid: 8613 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.956986:0:8613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807be00, rc 0) 00000100:00100000:3.0:1789061970.957054:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:2393:x1875967120347136:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 215us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061970.957060:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:1.0:1789061970.960354:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061970.960433:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120347392 00000100:00100000:3.0:1789061970.960442:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120347392 00000100:00100000:3.0:1789061970.960495:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00100000:3.0:1789061970.960505:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+74:12445:x1875967120347392:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789061970.960751:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+74:12445:x1875967120347392:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 248us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061970.960759:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 242 00000100:00100000:2.0:1789061970.963754:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061970.964333:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120347520 00000100:00100000:0.0:1789061970.964343:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120347520 00000100:00100000:0.0:1789061970.964399:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:0.0:1789061970.964408:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:12445:x1875967120347520:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789061970.964424:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061970.964442:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bbd0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061970.964470:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a9b4c5a/0x2774d8f311dc7765 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbc9 expref: 12 pid: 8613 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061970.964490:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061970.964495:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789061970.964500:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd0 expref: 12 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061970.964550:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a9b4c5a/0x2774d8f311dc7765 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbc9 expref: 12 pid: 8613 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061970.964563:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a9b4c5a/0x2774d8f311dc7765 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbc9 expref: 12 pid: 8613 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061970.964576:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1875967130879232:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789061970.964863:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c826e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789061970.968349:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061970.968443:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1875967130879232:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061970.968475:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd0 expref: 12 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.968494:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198200, rc 0) 00000100:00100000:2.0:1789061970.968558:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+12:12445:x1875967120347520:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 4151us (4813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061970.968566:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:1.0:1789061970.968662:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120347648 00000100:00100000:1.0:1789061970.968671:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120347648 00010000:00010000:1.0:1789061970.968702:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a9b4c5a/0x2774d8f311dc7765 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbc9 expref: 12 pid: 8613 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061970.968745:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 102 00000100:00100000:1.0:1789061970.968754:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+12:2393:x1875967120347648:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061970.968767:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061970.968787:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a9b4c5a/0x2774d8f311dc7765 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbc9 expref: 12 pid: 8613 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.968800:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a9b4c5a/0x2774d8f311dc7765 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbc9 expref: 12 pid: 8613 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.968822:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a9b4c5a/0x2774d8f311dc7765 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbc9 expref: 12 pid: 8613 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.968834:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061970.968838:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061970.968844:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd0 expref: 11 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.968873:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd0 expref: 11 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.968905:0:9499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd0 expref: 11 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061970.968919:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9499:1875967130879360:192.168.203.3@tcp:105: 00000100:00100000:1.0:1789061970.968966:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789061970.972458:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9499:1875967130879360:192.168.203.3@tcp:105: 00010000:00010000:3.0:1789061970.972483:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061970.972523:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:2393:x1875967120347648:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3770us (4182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061970.972542:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 102 00000100:00100000:0.0:1789061970.976513:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061970.976592:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120347776 00000100:00100000:3.0:1789061970.976649:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120347776 00002000:00100000:3.0:1789061970.976699:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9766c77a9c00 x1875967120347776/t0(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:391/0 lens 504/0 e 0 to 0 dl 1789061981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789061970.976711:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c77a9c00 with x1875967120347776 ext(0->12) 00002000:00010000:3.0:1789061970.976716:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c77a9c00 00000100:00100000:3.0:1789061970.976739:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1789061970.976749:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+11:2393:x1875967120347776:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789061970.977712:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:2393:x1875967120347776:12345-192.168.203.3@tcp:4:lhsmtool_posix.0 Request processed in 960us (1204us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789061970.977722:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00002000:00100000:3.0:1789061970.977730:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9766c77a9c00 x1875967120347776/t4294967321(0) o4->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:391/0 lens 504/448 e 0 to 0 dl 1789061981 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789061970.977738:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c77a9c00 with x1875967120347776 ext(0->12) 00002000:00010000:3.0:1789061970.977742:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c77a9c00 00000100:00100000:0.0:1789061970.980859:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061970.980948:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120347904 00000100:00100000:3.0:1789061970.980957:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120347904 00000100:00100000:3.0:1789061970.981079:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00100000:3.0:1789061970.981088:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+74:12445:x1875967120347904:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789061970.982924:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:2.0:1789061970.982941:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:2.0:1789061970.982978:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1789061970.982997:0:6474:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9766c65a0240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789061970.983001:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767c6f77900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9767d0192540 00000020:00080000:2.0:1789061970.983014:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767c6f77d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9766c6682400 00000004:00080000:2.0:1789061970.983039:0:6474:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1789061970.983063:0:6474:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9767c826e600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789061970.983066:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9766c81ffc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9767c826ecc0 00000020:00080000:2.0:1789061970.983068:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9766c81ffa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9766c6755000 00000020:00080000:2.0:1789061970.983078:0:6474:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1789061970.983178:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1789061970.983232:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789061970.983249:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c842ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130879488:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789061970.983313:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061970.983366:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130879488 00000100:00100000:2.0:1789061970.983372:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130879488 00000100:00100000:2.0:1789061970.983424:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789061970.983432:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875967130879488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789061970.983453:0:8613:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1789061970.983481:0:8613:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa2eb50, atime: 0x6aa2eb50, ctime: 0x6aa2eb50, blocks: 0x8 00010000:00010000:2.0:1789061970.983488:0:8613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e118a89/0x2774d8f311dc7773 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.983503:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1789061970.983507:0:8613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789061970.983513:0:8613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e118a89/0x2774d8f311dc7773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.983681:0:8613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e118a89/0x2774d8f311dc7773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.983693:0:8613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e118a89/0x2774d8f311dc7773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.983700:0:8613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e118a89/0x2774d8f311dc7773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.983727:0:8613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789061970.983838:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3623:x1875967130879488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 406us (524us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789061970.983844:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:2.0:1789061970.983865:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061970.983871:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e118a89/0x2774d8f311dc7773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.983880:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf000 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789061970.983885:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e118a89/0x2774d8f311dc7773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.983894:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e118a89/0x2774d8f311dc7773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.983910:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e118a89/0x2774d8f311dc7773 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.983917:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e118a89/0x2774d8f311dc7773 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.983934:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061970.983936:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061970.983937:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789061970.983964:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9766c842ad80/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789061970.983970:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c842ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130879488:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789061970.984147:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130879616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789061970.984179:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061970.984201:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789061970.984208:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130879744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789061970.984227:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061970.984254:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130879616 00000100:00100000:1.0:1789061970.984258:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130879616 00000100:00100000:1.0:1789061970.984282:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130879744 00000100:00100000:1.0:1789061970.984285:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130879744 00000100:00100000:1.0:1789061970.984298:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789061970.984304:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3620:x1875967130879616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789061970.984317:0:8411:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1789061970.984332:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.984347:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7527 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb28 expref: 12 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.984366:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1789061970.984369:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789061970.984373:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.984395:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7527 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb28 expref: 12 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.984408:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7527 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb28 expref: 12 pid: 8413 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061970.984419:0:8411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8173100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1875967130879872:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789061970.984481:0:8411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7840 going to sleep for 11 seconds 00000100:00100000:1.0:1789061970.984496:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789061970.984503:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3620:x1875967130879744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789061970.984593:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789061970.984597:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789061969 00002000:00010000:1.0:1789061970.984600:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789061970.984602:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789061969 -> 1789061969 00002000:00010000:1.0:1789061970.984620:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789061970.984663:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3620:x1875967130879744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (434us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789061970.984670:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1789061970.984698:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9766c8171880/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789061970.984709:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130879744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789061970.986274:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:12445:x1875967120347904:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 5181us (5418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061970.986284:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 243 00000100:00080000:2.0:1789061970.987451:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789061970.987460:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789061970.990089:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7471 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990106:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7471 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990114:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7471 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990138:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061970.990142:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7471 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990150:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7471 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990166:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9766c15c0200) 00010000:00010000:3.0:1789061970.990168:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061970.990173:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7471 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990179:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198800/0x2774d8f311dc7471 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990212:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990218:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7519 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990224:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990229:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061970.990232:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990238:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7519 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990256:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9767f385fe00) 00010000:00010000:3.0:1789061970.990258:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061970.990262:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7519 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990268:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198600/0x2774d8f311dc7519 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990286:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7597 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990304:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7597 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990310:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7597 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990316:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061970.990319:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7597 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990325:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7597 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990333:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767f385ff00) 00010000:00010000:3.0:1789061970.990335:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061970.990338:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7597 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990344:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199a00/0x2774d8f311dc7597 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990368:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc75ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990374:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc75ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990380:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc75ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990385:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613fe00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061970.990388:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc75ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990394:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc75ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990402:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9767f385ff00) 00010000:00010000:3.0:1789061970.990404:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061970.990407:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc75ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990412:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613fe00/0x2774d8f311dc75ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990442:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc768c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990448:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc768c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990454:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc768c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990465:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767d613ec00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061970.990467:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc768c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990473:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc768c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990480:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:3.0:1789061970.990482:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789061970.990485:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc768c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990490:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613ec00/0x2774d8f311dc768c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990503:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7749 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990508:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7749 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990513:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7749 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990518:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807aa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789061970.990521:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7749 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990526:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7749 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990554:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:3.0:1789061970.990556:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789061970.990559:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7749 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061970.990565:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7749 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061970.992432:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061970.992461:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061970.992827:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120348160 00000100:00100000:3.0:1789061970.992836:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120348160 00000100:00100000:3.0:1789061970.992897:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:3.0:1789061970.992907:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+13:2392:x1875967120348160:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789061970.993138:0:8411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8173100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1875967130879872:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789061970.993165:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061970.993950:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120348032 00000100:00100000:2.0:1789061970.993958:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120348032 00010000:00010000:2.0:1789061970.993985:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7527 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb28 expref: 14 pid: 8413 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061970.994369:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:2.0:1789061970.994399:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+14:2392:x1875967120348032:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061970.994412:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061970.994418:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7527 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb28 expref: 14 pid: 8413 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.994431:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7527 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb28 expref: 14 pid: 8413 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.994452:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7527 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb28 expref: 14 pid: 8413 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.994465:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061970.994469:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061970.994474:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.994495:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.994786:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.994796:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789061970.994796:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1789061970.994808:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00010000:00010000:1.0:1789061970.994810:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.994820:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.994841:0:8411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061970.995037:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061970.995080:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2392:x1875967120348032:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 684us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061970.995087:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 103 00000100:00100000:3.0:1789061970.995171:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2392:x1875967120348160:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 2265us (2707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061970.995178:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 76 00000100:00100000:1.0:1789061970.995299:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875967130879616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10994us (11119us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789061970.995306:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1789061970.995326:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061970.995332:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.995340:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789061970.995352:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.995362:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.995376:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.995383:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9fecfd8/0x2774d8f311dc777a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061970.995399:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061970.995401:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061970.995403:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061970.995971:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1789061970.995979:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1789061970.995997:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9766c8171880, transno 4294967322 00000100:00100000:0.0:1789061970.996260:0:3620:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9766c8170e00 x1875967130879616/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789061986 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789061970.996285:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9766c8170e00/2, rc 0, transno 4294967323 00000100:00100000:0.0:1789061970.996497:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130879616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789061970.998558:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061970.998717:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120348416 00000100:00100000:2.0:1789061970.998726:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120348416 00000100:00100000:2.0:1789061970.998783:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00100000:2.0:1789061970.998793:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:12445:x1875967120348416:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789061970.998840:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061970.998864:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cee00/0x2774d8f311dc775e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbc2 expref: 21 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.998882:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:2.0:1789061970.998887:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789061970.998914:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7781 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.998927:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.998936:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789061970.999049:0:8435:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a22a0162 reply state 00000000f11323ca transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.999074:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7781 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061970.999079:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:2.0:1789061970.999082:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789061970.999085:0:8435:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789061970.999166:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:12445:x1875967120348416:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 375us (614us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1789061970.999173:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 244 00000100:00100000:1.0:1789061971.002216:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061971.002406:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120348544 00000100:00100000:0.0:1789061971.002415:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120348544 00000100:00100000:0.0:1789061971.002472:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:0.0:1789061971.002481:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2393:x1875967120348544:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789061971.002659:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789061971.002663:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789061969 -> 1789061968 00002000:00010000:0.0:1789061971.002665:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789061968 00002000:00010000:0.0:1789061971.002667:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789061969 -> 1789061968 00002000:00010000:0.0:1789061971.002669:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789061971.002723:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8173100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120348544:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 243us (515us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789061971.002731:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 77 00000100:00100000:0.0:1789061971.005396:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061971.005476:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120348800 00000100:00100000:3.0:1789061971.005485:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120348800 00000100:00100000:3.0:1789061971.005543:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 245 00000100:00100000:3.0:1789061971.005551:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:12445:x1875967120348800:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789061971.005649:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.005665:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7742 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbb4 expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.005675:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.005727:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7742 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbb4 expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.005741:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7742 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbb4 expref: 22 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061971.005755:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130880000:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061971.005823:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6750f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789061971.008984:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130880000:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061971.009020:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061971.010659:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061971.010897:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120348928 00000100:00100000:3.0:1789061971.010905:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120348928 00010000:00010000:3.0:1789061971.010943:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7742 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbb4 expref: 23 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061971.010982:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 104 00000100:00100000:3.0:1789061971.010992:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+23:2391:x1875967120348928:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061971.011005:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061971.011022:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7742 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbb4 expref: 23 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.011034:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7742 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbb4 expref: 23 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.011076:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc7742 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbb4 expref: 23 pid: 6498 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.011091:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:3.0:1789061971.011096:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.011105:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.011112:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.011144:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061971.011321:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:2391:x1875967120348928:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 330us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061971.011330:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 104 00010000:00010000:0.0:1789061971.011504:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.011512:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.011549:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.011556:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.011573:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.011579:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807aa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061971.011582:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.011590:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.011598:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:0.0:1789061971.011601:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789061971.011630:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.011645:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc7788 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061971.011686:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:12445:x1875967120348800:12345-192.168.203.3@tcp:55:lhsmtool_posix.0 Request processed in 6135us (6298us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789061971.011694:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 245 00000100:00100000:2.0:1789061971.014445:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061971.014512:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120349056 00000100:00100000:3.0:1789061971.014521:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120349056 00000100:00100000:3.0:1789061971.014575:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:3.0:1789061971.014583:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2393:x1875967120349056:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789061971.014779:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.014798:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd0 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.014824:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789061971.014828:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789061971.014833:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.014863:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd0 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.014877:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd0 expref: 8 pid: 8413 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061971.014891:0:8413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1875967130880128:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061971.014985:0:8413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6750f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061971.018453:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061971.018522:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120349184 00000100:00100000:0.0:1789061971.018540:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120349184 00010000:00010000:0.0:1789061971.018575:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd0 expref: 9 pid: 8413 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061971.018765:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 105 00000100:00100000:2.0:1789061971.018776:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8429880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2393:x1875967120349184:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061971.018792:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061971.018814:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd0 expref: 9 pid: 8413 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.018828:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd0 expref: 9 pid: 8413 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.018852:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061971.018857:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789061971.018864:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.018873:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.018908:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061971.019051:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8429880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+9:2393:x1875967120349184:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 277us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061971.019060:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 105 00010000:00010000:3.0:1789061971.019189:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004013be2/0x2774d8f311dc776c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd0 expref: 8 pid: 8413 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061971.019203:0:8413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1875967130880128:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061971.019220:0:8413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.019273:0:8413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.019282:0:8413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.019389:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.019398:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.019413:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.019419:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807ae00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789061971.019423:0:8413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.019431:0:8413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.019443:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.019450:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc778f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061971.019495:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2393:x1875967120349056:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 4912us (5057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061971.019502:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 78 00000100:00100000:0.0:1789061971.023092:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061971.023192:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120349440 00000100:00100000:2.0:1789061971.023201:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120349440 00000100:00100000:2.0:1789061971.023284:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 246 00000100:00100000:2.0:1789061971.023361:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:12445:x1875967120349440:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789061971.023436:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.023454:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7685 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb7c expref: 21 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.023464:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.023496:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7685 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb7c expref: 21 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.023509:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7685 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb7c expref: 21 pid: 10077 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061971.023591:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8428e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130880256:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061971.023881:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789061971.026876:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8428e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130880256:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061971.026915:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061971.027595:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061971.028357:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120349568 00000100:00100000:1.0:1789061971.028366:0:9499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120349568 00010000:00010000:1.0:1789061971.028400:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7685 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb7c expref: 22 pid: 10077 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061971.028473:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 106 00000100:00100000:1.0:1789061971.028492:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:2393:x1875967120349568:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061971.028506:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061971.028513:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7685 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb7c expref: 22 pid: 10077 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.028524:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7685 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb7c expref: 22 pid: 10077 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.028646:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767d613e000/0x2774d8f311dc7685 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb7c expref: 22 pid: 10077 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.028662:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061971.028668:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc76e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb9f expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.028678:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.028684:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.028691:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.028771:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061971.028827:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:2393:x1875967120349568:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 336us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061971.028835:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 106 00010000:00010000:2.0:1789061971.029935:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.029947:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.030396:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.030411:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7750 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbbb expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.030418:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.030452:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7750 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbbb expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.030468:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7750 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbbb expref: 21 pid: 6496 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061971.030483:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8428e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130880384:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789061971.030820:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1238a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789061971.033869:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8428e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130880384:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789061971.033898:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061971.034965:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061971.035206:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120349696 00000100:00100000:2.0:1789061971.035214:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120349696 00010000:00010000:2.0:1789061971.035248:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7750 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbbb expref: 22 pid: 6496 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061971.035285:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 107 00000100:00100000:2.0:1789061971.035305:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c6299c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:2393:x1875967120349696:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061971.035318:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061971.035325:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7750 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbbb expref: 22 pid: 6496 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.035336:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7750 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbbb expref: 22 pid: 6496 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.035358:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7750 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbbb expref: 22 pid: 6496 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.035372:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:2.0:1789061971.035377:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.035386:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.035394:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.035424:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061971.035480:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c6299c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:2393:x1875967120349696:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 177us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061971.035488:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 107 00010000:00010000:3.0:1789061971.035640:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.035649:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789061971.035762:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1789061971.035865:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:3.0:1789061971.035900:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1789061971.035967:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1875967130880512:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789061971.036019:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061971.036043:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789061971.036175:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130880512 00000100:00100000:2.0:1789061971.036180:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130880512 00000100:00100000:2.0:1789061971.036218:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789061971.036225:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6497:x1875967130880512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789061971.036298:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6497:x1875967130880512:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061971.036304:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789061971.036393:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1875967130880512:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789061971.036486:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:3.0:1789061971.036526:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1875967130880640:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789061971.036551:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061971.036573:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727180 going to sleep for 11 seconds 00000100:00100000:2.0:1789061971.036899:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130880640 00000100:00100000:2.0:1789061971.036904:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130880640 00000100:00100000:2.0:1789061971.036939:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789061971.036946:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6497:x1875967130880640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789061971.037084:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6497:x1875967130880640:12345-0@lo:1000:mdt00_001.0 Request processed in 139us (531us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789061971.037091:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789061971.037835:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1875967130880640:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789061971.037879:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.037887:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.037894:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.037899:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061971.037903:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.037910:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.037923:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:1.0:1789061971.037926:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061971.037930:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.037936:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc779d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.037959:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.037966:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76e0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.037971:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.037986:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47be00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061971.037989:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.037994:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76e0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.038004:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061971.038006:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789061971.038074:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc76e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb9f expref: 24 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.038085:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc76e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb9f expref: 24 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.038094:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc76e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb9f expref: 24 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.038124:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc76e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb9f expref: 24 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061971.038137:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130880768:192.168.203.3@tcp:105: 00000100:00100000:1.0:1789061971.038298:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7840 going to sleep for 11 seconds 00000100:00100000:0.0:1789061971.042516:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061971.042849:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120349824 00000100:00100000:2.0:1789061971.042857:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120349824 00000100:00100000:2.0:1789061971.042941:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:2.0:1789061971.042952:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:12444:x1875967120349824:12345-192.168.203.3@tcp:49:lfs.0 00000100:00100000:1.0:1789061971.043470:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1875967130880768:192.168.203.3@tcp:105: 00010000:00010000:1.0:1789061971.043497:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76e0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043533:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc76e0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043566:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043580:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043593:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043602:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043650:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77a4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043657:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043663:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ba00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061971.043667:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043674:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77a4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043684:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061971.043687:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061971.043691:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77a4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043704:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77a4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043715:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043721:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043727:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043732:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061971.043735:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043741:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043749:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061971.043751:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789061971.043753:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061971.043758:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce000/0x2774d8f311dc7796 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061971.043907:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+25:12444:x1875967120349824:12345-192.168.203.3@tcp:49:lfs.0 Request processed in 957us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061971.043916:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:1.0:1789061971.044178:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:12445:x1875967120349440:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 20822us (21093us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789061971.044187:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 246 00000020:00080000:1.0:1789061971.044197:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789061971.044283:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061971.044287:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061971.044945:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789061971.044954:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061971.049903:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061971.049977:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061971.050091:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120350336 00000100:00100000:3.0:1789061971.050101:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120350336 00000100:00100000:3.0:1789061971.050156:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:3.0:1789061971.050166:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f06450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+24:12445:x1875967120350336:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789061971.050423:0:6499:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789061971.050451:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1789061971.050481:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.050497:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.050509:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.050517:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789061971.050752:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120350080 00000100:00100000:1.0:1789061971.050757:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120350080 00010000:00010000:3.0:1789061971.050859:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.050865:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.050886:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789061971.050971:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f06450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:12445:x1875967120350336:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 806us (993us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789061971.050978:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000020:00080000:3.0:1789061971.050983:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789061971.051067:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 247 00000100:00100000:1.0:1789061971.051077:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+26:12444:x1875967120350080:12345-192.168.203.3@tcp:58:lfs.0 00000040:00080000:1.0:1789061971.051177:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789061971.051216:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+26:12444:x1875967120350080:12345-192.168.203.3@tcp:58:lfs.0 Request processed in 141us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061971.051222:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 247 00010000:00010000:2.0:1789061971.051273:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061971.051286:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.051302:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a000 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789061971.051306:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.051313:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.051326:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:2.0:1789061971.051329:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789061971.051333:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77ab lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.051339:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061971.051351:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061971.051353:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061971.051354:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061971.085404:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061971.085489:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120350464 00000100:00100000:3.0:1789061971.085498:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120350464 00000100:00100000:3.0:1789061971.085567:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 248 00000100:00100000:3.0:1789061971.085577:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+26:12447:x1875967120350464:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789061971.085597:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789061971.085653:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc77b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bbd7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.085717:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ba00/0x2774d8f311dc77b9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.085730:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ba00/0x2774d8f311dc77b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.085741:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ba00/0x2774d8f311dc77b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.085755:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.085775:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.085781:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.085852:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc77c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.085861:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb98 expref: 27 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.085868:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc77c7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.085899:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb98 expref: 27 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.085913:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb98 expref: 27 pid: 8435 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061971.085926:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130880896:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789061971.086022:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727900 going to sleep for 11 seconds 00000100:00100000:0.0:1789061971.089137:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061971.089225:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120350720 00000100:00100000:2.0:1789061971.089233:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120350720 00000100:00100000:2.0:1789061971.089305:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1789061971.089315:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+28:6162:x1875967120350720:12345-192.168.203.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789061971.089518:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:6162:x1875967120350720:12345-192.168.203.3@tcp:35:ldlm_bl.0 Request processed in 205us (388us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789061971.089535:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:3.0:1789061971.089793:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1875967130880896:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789061971.089819:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc77c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061971.093264:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061971.093705:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120350848 00000100:00100000:3.0:1789061971.093730:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120350848 00010000:00010000:3.0:1789061971.093768:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb98 expref: 29 pid: 8435 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789061971.093810:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 108 00000100:00100000:3.0:1789061971.093820:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:2393:x1875967120350848:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061971.093834:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061971.093841:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb98 expref: 29 pid: 8435 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.093854:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb98 expref: 29 pid: 8435 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.093876:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199400/0x2774d8f311dc76d2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb98 expref: 29 pid: 8435 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.093892:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:3.0:1789061971.093897:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc77c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.093906:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc77c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.093913:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc77c7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061971.094129:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061971.094190:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+28:2393:x1875967120350848:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 371us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061971.094207:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 108 00010000:00010000:0.0:1789061971.095691:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc77c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095704:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc77c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061971.095755:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789061971.095759:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789061971.095781:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc77c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095796:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc77c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095806:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ba00/0x2774d8f311dc77b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095813:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ba00/0x2774d8f311dc77b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095820:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ba00/0x2774d8f311dc77b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095826:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807ba00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061971.095830:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ba00/0x2774d8f311dc77b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095837:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ba00/0x2774d8f311dc77b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095865:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:0.0:1789061971.095867:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061971.095873:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ba00/0x2774d8f311dc77b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095878:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ba00/0x2774d8f311dc77b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095891:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095896:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095901:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095905:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061971.095907:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095912:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095918:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9766c7417900) 00010000:00010000:0.0:1789061971.095920:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061971.095923:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.095928:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc77c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.096121:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc77b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd7 expref: 28 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.096137:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc77c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd7 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061971.096144:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:0.0:1789061971.096146:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061971.096149:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807aa00, rc 0) 00000100:00100000:0.0:1789061971.096255:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:12447:x1875967120350464:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 10678us (10858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061971.096264:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 248 00000100:00100000:0.0:1789061971.113920:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130881024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789061971.113987:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061971.114193:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130881024 00000100:00100000:1.0:1789061971.114201:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130881024 00000100:00100000:1.0:1789061971.114250:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789061971.114258:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130881024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789061971.114289:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789061971.114343:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130881024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061971.114349:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789061971.114435:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130881024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061971.625874:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130881152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061971.625922:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061971.625944:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130881280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061971.625954:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061971.625984:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061971.626019:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130881152 00000100:00100000:2.0:1789061971.626040:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130881152 00000100:00100000:2.0:1789061971.626097:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130881280 00000100:00100000:2.0:1789061971.626101:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130881280 00000100:00100000:0.0:1789061971.626122:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789061971.626135:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130881152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789061971.626162:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061971.626209:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130881152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (256us total) trans 0 rc 0/0 00000100:00080000:3.0:1789061971.626460:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061971.629841:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130881152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061971.630676:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789061971.630706:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875967130881280:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061971.630714:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00002000:00000024:2.0:1789061971.630731:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061971.631755:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875967130881280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1056us (5767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061971.631765:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789061971.632781:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130881280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061971.720505:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061971.720701:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061971.720739:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061971.720760:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061971.720778:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061971.720801:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061971.720827:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061971.720879:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120350976 00000100:00100000:0.0:1789061971.720898:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120350976 00000100:00100000:0.0:1789061971.720950:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 384 00000100:00100000:0.0:1789061971.720960:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2390:x1875967120350976:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061971.721039:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2390:x1875967120350976:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 80us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061971.721048:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 384 00000100:00100000:1.0:1789061971.722188:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120351104 00000100:00100000:1.0:1789061971.722200:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120351104 00000100:00100000:1.0:1789061971.722251:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120351232 00000100:00100000:1.0:1789061971.722254:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120351232 00000100:00100000:1.0:1789061971.722276:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120351616 00000100:00100000:1.0:1789061971.722279:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120351616 00000100:00100000:1.0:1789061971.722293:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120351744 00000100:00100000:1.0:1789061971.722295:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120351744 00000100:00100000:1.0:1789061971.722312:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 307 00000100:00100000:1.0:1789061971.722320:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:2391:x1875967120351104:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061971.722380:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:2391:x1875967120351104:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 61us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061971.722389:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 307 00000100:00100000:1.0:1789061971.722405:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 308 00000100:00100000:1.0:1789061971.722411:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120351232:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061971.722432:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2390:x1875967120351232:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061971.722439:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 308 00000100:00100000:1.0:1789061971.722449:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 309 00000100:00100000:1.0:1789061971.722455:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120351616:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061971.722476:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120351616:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061971.722482:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 309 00000100:00100000:1.0:1789061971.722494:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 310 00000100:00100000:1.0:1789061971.722502:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120351744:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061971.722522:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2390:x1875967120351744:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061971.722538:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 310 00000100:00100000:1.0:1789061971.722562:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120351360 00000100:00100000:1.0:1789061971.722566:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120351360 00000100:00100000:1.0:1789061971.722594:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120351488 00000100:00100000:1.0:1789061971.722597:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120351488 00000100:00100000:1.0:1789061971.722654:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 146 00000100:00100000:1.0:1789061971.722663:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120351360:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061971.722693:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120351360:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 32us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061971.722700:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 146 00000100:00100000:1.0:1789061971.722719:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:1.0:1789061971.722728:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2390:x1875967120351488:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061971.722749:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2390:x1875967120351488:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061971.722755:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00080000:1.0:1789061971.722783:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061971.722787:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061971.722790:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789061971.753754:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789061971.797871:0:14683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061971.797880:0:14683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789061971.798599:0:14683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789061971.798726:0:14683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789061972.074919:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061972.074928:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061972.074954:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789061972.074963:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061972.075100:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13772:1875967130881408:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789061972.075212:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c80a7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789061972.088528:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061972.088597:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120351872 00000100:00100000:2.0:1789061972.088655:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120351872 00000100:00100000:2.0:1789061972.088726:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 249 00000100:00100000:2.0:1789061972.088738:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+28:12460:x1875967120351872:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1789061972.088741:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:2.0:1789061972.088769:0:6497:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789061972.088886:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+28:12460:x1875967120351872:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 151us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061972.088894:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 249 00000100:00100000:1.0:1789061972.089084:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13772:1875967130881408:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789061972.097686:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061972.097792:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120352128 00000100:00100000:1.0:1789061972.097804:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120352128 00000100:00100000:1.0:1789061972.097869:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 250 00000100:00100000:1.0:1789061972.097881:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+27:12460:x1875967120352128:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789061972.097900:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061972.097920:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc77ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bbde expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061972.098022:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061972.098038:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061972.098052:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789061972.098064:0:8435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789061972.098169:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47be00/0x2774d8f311dc77ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbde expref: 30 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061972.098188:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbde expref: 29 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061972.098198:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061972.098201:0:8435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789061972.098205:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47ba00, rc 0) 00000100:00100000:1.0:1789061972.098262:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:12460:x1875967120352128:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 383us (585us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789061972.098287:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 250 00000100:00100000:3.0:1789061972.106808:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061972.107155:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120352384 00000100:00100000:0.0:1789061972.107165:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120352384 00000100:00100000:0.0:1789061972.107228:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 251 00000100:00100000:0.0:1789061972.107238:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:12460:x1875967120352384:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789061972.107317:0:10077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061972.107346:0:10077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061972.107357:0:10077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061972.107869:0:10077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061972.107878:0:10077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77e3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061972.107885:0:10077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061972.107890:0:10077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061972.107907:0:10077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061972.107915:0:10077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77e3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061972.107927:0:10077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:0.0:1789061972.107931:0:10077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789061972.107936:0:10077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77e3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061972.107942:0:10077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77e3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10077 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061972.108064:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:12460:x1875967120352384:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 825us (1263us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789061972.108073:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 251 00000040:00080000:1.0:1789061972.108204:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061972.108208:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061972.108957:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789061972.108968:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789061972.112326:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061972.112365:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061972.112872:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120352512 00000100:00100000:1.0:1789061972.112883:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120352512 00000100:00100000:1.0:1789061972.112952:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1789061972.112963:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:2391:x1875967120352512:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789061972.112977:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061972.113000:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc77d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbde expref: 30 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061972.113017:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:1.0:1789061972.113022:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061972.113079:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:2391:x1875967120352512:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 118us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061972.113086:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:2.0:1789061972.113265:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120352768 00000100:00100000:2.0:1789061972.113270:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120352768 00000100:00100000:2.0:1789061972.113307:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1789061972.113314:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+29:12460:x1875967120352768:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789061972.113515:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:12460:x1875967120352768:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 201us (1198us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789061972.113522:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00010000:00010000:1.0:1789061972.778045:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061973.161892:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789061973.161923:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130881920:0@lo:400:kworker.0 00000100:00100000:3.0:1789061973.161953:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130881664:0@lo:400:kworker.0 00000100:00100000:3.0:1789061973.161985:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061973.162013:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130881792:0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.162042:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061973.162106:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130882048:0@lo:400:kworker.0 00000100:00100000:1.0:1789061973.166146:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061973.166165:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130882304:0@lo:400:kworker.0 00000100:00100000:1.0:1789061973.166172:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130882560:0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.166268:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061973.166305:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130882816:0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.166464:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061973.166518:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130881664 00000100:00100000:0.0:1789061973.166526:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130881664 00000100:00100000:0.0:1789061973.166567:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130882304 00000100:00100000:0.0:1789061973.166571:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130882304 00000100:00100000:0.0:1789061973.166646:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130882816 00000100:00100000:0.0:1789061973.166650:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130882816 00000100:00100000:0.0:1789061973.166669:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789061973.166676:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130881664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.166725:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130881664:12345-0@lo:400:kworker.0 Request processed in 48us (4739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061973.166731:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789061973.166748:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789061973.166754:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130882304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.166784:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130882304:12345-0@lo:400:kworker.0 Request processed in 31us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061973.166790:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789061973.166811:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789061973.166818:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130882816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.166844:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130882816:12345-0@lo:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061973.166850:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00080000:0.0:1789061973.166893:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c83a5c00 x1875967130882304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061973.167088:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130882304:0@lo:400:kworker.0 00010000:00080000:0.0:1789061973.167103:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c83a6680 x1875967130882816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061973.167111:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130882816:0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.167146:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130881792 00000100:00100000:0.0:1789061973.167149:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130881792 00000100:00100000:0.0:1789061973.167183:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130882048 00000100:00100000:0.0:1789061973.167186:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130882048 00000100:00100000:0.0:1789061973.167198:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789061973.167203:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130881792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.167241:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130881792:12345-0@lo:400:kworker.0 Request processed in 38us (5199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061973.167248:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789061973.167260:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789061973.167265:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130882048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.167775:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130882048:12345-0@lo:400:kworker.0 Request processed in 508us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061973.167782:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789061973.167827:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130881792:0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.167867:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061973.167909:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130882432:0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.167937:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061973.167957:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130881536:0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.167981:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061973.168018:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130882944:0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.168040:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061973.168066:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130881536 00000100:00100000:0.0:1789061973.168070:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130881536 00000100:00100000:0.0:1789061973.168093:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1789061973.168101:0:6491:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130881536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.168135:0:6491:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130881536:12345-0@lo:400:kworker.0 Request processed in 35us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061973.168147:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1789061973.168177:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130881536:0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.168192:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130881920 00000100:00100000:0.0:1789061973.168195:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130881920 00000100:00100000:0.0:1789061973.168216:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789061973.168222:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130881920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.168254:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130881920:12345-0@lo:400:kworker.0 Request processed in 33us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061973.168260:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789061973.168287:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130881920:0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.168321:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130882432 00000100:00100000:0.0:1789061973.168325:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130882432 00000100:00100000:0.0:1789061973.168349:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130882944 00000100:00100000:0.0:1789061973.168353:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130882944 00000100:00100000:0.0:1789061973.168370:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789061973.168376:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130882432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.168407:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130882432:12345-0@lo:400:kworker.0 Request processed in 31us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061973.168413:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789061973.168424:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789061973.168429:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130882944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.168453:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130882944:12345-0@lo:400:kworker.0 Request processed in 24us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061973.168459:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789061973.168485:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130882944:0@lo:400:kworker.0 00000100:00100000:0.0:1789061973.168506:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130882432:0@lo:400:kworker.0 00000100:00080000:0.0:1789061973.168751:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061973.168755:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789061973.168758:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061973.170564:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061973.170633:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130883072:0@lo:400:kworker.0 00000100:00100000:1.0:1789061973.170679:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061973.170736:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130882048:0@lo:400:kworker.0 00000100:00100000:1.0:1789061973.170770:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130882560 00000100:00100000:1.0:1789061973.170775:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130882560 00000100:00100000:1.0:1789061973.170817:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130883072 00000100:00100000:1.0:1789061973.170820:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130883072 00000100:00100000:1.0:1789061973.170854:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789061973.170861:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3621:x1875967130882560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061973.170912:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3621:x1875967130882560:12345-0@lo:400:kworker.0 Request processed in 50us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061973.170919:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789061973.170935:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789061973.170941:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3621:x1875967130883072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061973.170978:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3621:x1875967130883072:12345-0@lo:400:kworker.0 Request processed in 37us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061973.170984:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1789061973.171004:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061973.171008:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061973.171029:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130882560:0@lo:400:kworker.0 00000100:00100000:1.0:1789061973.171040:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130883072:0@lo:400:kworker.0 00000100:00100000:3.0:1789061973.171280:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130881664:0@lo:400:kworker.0 00000100:00100000:3.0:1789061973.171298:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130882176:0@lo:400:kworker.0 00000100:00100000:3.0:1789061973.171334:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061973.171352:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130882688:0@lo:400:kworker.0 00000100:00100000:3.0:1789061973.171369:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061973.171408:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130882176 00000100:00100000:3.0:1789061973.171412:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130882176 00000100:00100000:3.0:1789061973.171438:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130882688 00000100:00100000:3.0:1789061973.171440:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130882688 00000100:00100000:3.0:1789061973.171457:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789061973.171462:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130882176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061973.171491:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130882176:12345-0@lo:400:kworker.0 Request processed in 29us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061973.171497:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789061973.171655:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789061973.171662:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130882688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061973.171688:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875967130882688:12345-0@lo:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061973.171694:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:3.0:1789061973.171710:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789061973.171729:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130882176:0@lo:400:kworker.0 00000100:00100000:3.0:1789061973.171737:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875967130882688:0@lo:400:kworker.0 00000040:00080000:0.0:1789061973.600793:0:14734:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789061973.600803:0:14734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789061973.600834:0:14734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789061973.600840:0:14734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789061973.673775:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c842b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130883200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789061973.673839:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061973.673974:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130883200 00000100:00100000:3.0:1789061973.673981:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130883200 00000100:00100000:3.0:1789061973.674035:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789061973.674043:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130883200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789061973.674072:0:7866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789061973.674121:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130883200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061973.674132:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789061973.674269:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c842b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130883200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789061973.677823:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061973.677844:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130883328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061973.677908:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061973.678010:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130883456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061973.678048:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061973.678093:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130883328 00000100:00100000:0.0:1789061973.678099:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130883328 00000100:00100000:0.0:1789061973.678147:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130883456 00000100:00100000:0.0:1789061973.678151:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130883456 00000100:00100000:0.0:1789061973.678181:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789061973.678192:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875967130883328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061973.678207:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00002000:00000024:0.0:1789061973.678220:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789061973.678225:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130883456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789061973.678240:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789061973.678273:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875967130883328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061973.678282:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789061973.678285:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130883456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061973.678294:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789061973.678341:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130883328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061973.678389:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130883456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789061973.742924:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061973.743023:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120353024 00000100:00100000:0.0:1789061973.743033:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120353024 00000100:00100000:0.0:1789061973.743091:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 252 00000100:00100000:0.0:1789061973.743102:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+30:12481:x1875967120353024:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789061973.743133:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061973.743153:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc77ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bbe5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.743253:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.743268:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.743280:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061973.743292:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789061973.743391:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc77ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbe5 expref: 33 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.743409:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbe5 expref: 32 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.743418:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:0.0:1789061973.743421:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789061973.743425:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198a00, rc 0) 00000100:00100000:0.0:1789061973.743477:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:12481:x1875967120353024:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 377us (563us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1789061973.743484:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 252 00000100:00100000:0.0:1789061973.757048:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061973.757082:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120353152 00000100:00100000:0.0:1789061973.757092:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120353152 00000100:00100000:0.0:1789061973.757152:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 253 00000100:00100000:0.0:1789061973.757161:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:12481:x1875967120353152:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:0.0:1789061973.757221:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc77ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.757238:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc77ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.757250:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc77ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.757285:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc77ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.757292:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc77ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.757299:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc77ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.757306:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789061973.757311:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc77ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.757318:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc77ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.757330:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:0.0:1789061973.757333:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789061973.757338:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc77ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061973.757355:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199600/0x2774d8f311dc77ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789061973.757417:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+32:12481:x1875967120353152:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 256us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061973.757425:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 253 00010000:00010000:2.0:1789061973.801815:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061973.850515:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061973.850658:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120353280 00000100:00100000:1.0:1789061973.850667:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120353280 00000100:00100000:1.0:1789061973.850734:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:1.0:1789061973.850744:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2390:x1875967120353280:12345-192.168.203.3@tcp:101:cat.0 00000100:00080000:3.0:1789061973.850754:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789061973.850762:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789061973.850781:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9b98a85/0x2774d8f311dc7806 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bbec expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789061973.850824:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa2eb50, atime: 0x6aa2eb50, ctime: 0x6aa2eb50, blocks: 0x8 00010000:00010000:1.0:1789061973.850843:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1789061973.850848:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789061973.850857:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9b98a85/0x2774d8f311dc7806 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbec expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061973.850875:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9b98a85/0x2774d8f311dc7806 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbec expref: 8 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061973.850888:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a200, rc 0) 00000100:00100000:1.0:1789061973.850948:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2390:x1875967120353280:12345-192.168.203.3@tcp:101:cat.0 Request processed in 205us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061973.850955:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:0.0:1789061973.858708:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061973.858895:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120353408 00000100:00100000:3.0:1789061973.858909:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120353408 00002000:00100000:3.0:1789061973.858962:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9766c77aad80 x1875967120353408/t0(0) o3->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:394/0 lens 488/0 e 0 to 0 dl 1789061984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789061973.858971:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c77aad80 with x1875967120353408 ext(0->4095) 00002000:00010000:3.0:1789061973.858976:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c77aad80 00000100:00100000:3.0:1789061973.859010:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:3.0:1789061973.859017:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2391:x1875967120353408:12345-192.168.203.3@tcp:3:cat.0 00000100:00100000:3.0:1789061973.862398:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+8:2391:x1875967120353408:12345-192.168.203.3@tcp:3:cat.0 Request processed in 3369us (3688us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789061973.862413:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00002000:00100000:3.0:1789061973.862427:0:8417:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9766c77aad80 x1875967120353408/t0(0) o3->8b387fcf-29cb-4ebc-866a-7eab61aa3868@192.168.203.3@tcp:394/0 lens 488/4536 e 0 to 0 dl 1789061984 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789061973.862438:0:8417:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9766c77aad80 with x1875967120353408 ext(0->4095) 00002000:00010000:3.0:1789061973.862444:0:8417:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9766c77aad80 00000001:00080000:0.0:1789061974.700961:0:8406:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:3.0:1789061974.830856:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061975.852928:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061976.233836:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130883584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061976.233932:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061976.234507:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130883584 00000100:00100000:0.0:1789061976.234517:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130883584 00000100:00100000:0.0:1789061976.234592:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789061976.234766:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130883584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789061976.234810:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789061976.237776:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130883584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3003us (3832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061976.237793:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789061976.240446:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130883584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789061976.745775:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130883712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061976.746055:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061976.746122:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061976.746130:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130883840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789061976.746156:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061976.746205:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130883712 00000100:00100000:1.0:1789061976.746213:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130883712 00000100:00100000:1.0:1789061976.746260:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130883840 00000100:00100000:1.0:1789061976.746263:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130883840 00000100:00100000:1.0:1789061976.746284:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789061976.746293:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130883712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061976.746342:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061976.746390:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130883712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061976.746397:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789061976.746416:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789061976.746423:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130883840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789061976.746433:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789061976.746456:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130883840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061976.746463:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1789061976.746520:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061976.746646:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130883840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789061976.746660:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789061976.746665:0:3622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1789061976.746687:0:3622:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9766c842ad80, transno 4294967311 00000100:00100000:0.0:1789061976.746706:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130883712:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789061976.747932:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1789061976.747945:0:9490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1789061976.749321:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789061976.749353:0:6474:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9766c65a0cc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789061976.749358:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767c6f77b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9766c65a0540 00000020:00080000:2.0:1789061976.749361:0:6474:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9767c6f77c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9767c300a400 00000020:00080000:2.0:1789061976.749378:0:6474:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789061976.749389:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789061976.749450:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1789061976.749760:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7781 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061976.750049:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7781 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061976.750060:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7781 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061976.750066:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789061976.750070:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7781 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061976.750078:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7781 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061976.750096:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9766c7417800) 00010000:00010000:1.0:1789061976.750099:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789061976.750104:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7781 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061976.750119:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf000/0x2774d8f311dc7781 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789061976.839752:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061976.839899:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061976.841934:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120353536 00000100:00100000:0.0:1789061976.841945:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120353536 00000100:00100000:0.0:1789061976.842002:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 386 00000100:00100000:0.0:1789061976.842012:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2390:x1875967120353536:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061976.842090:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:21c8093b-edf9-482d-a900-a6298c53147f+13:2390:x1875967120353536:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 79us (2346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061976.842098:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 386 00000100:00100000:1.0:1789061976.843218:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120353664 00000100:00100000:1.0:1789061976.843226:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120353664 00000100:00100000:1.0:1789061976.844924:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 317 00000100:00100000:1.0:1789061976.844938:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:2390:x1875967120353664:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061976.845017:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:2390:x1875967120353664:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 83us (5118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061976.845024:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 317 00000100:00080000:3.0:1789061976.849970:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061976.850432:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061976.850471:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061976.850499:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061976.850519:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061976.850542:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061976.850567:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120354176 00000100:00100000:0.0:1789061976.850576:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120354176 00000100:00100000:1.0:1789061976.850640:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120353920 00000100:00100000:1.0:1789061976.850644:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120353920 00000100:00100000:0.0:1789061976.850658:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120353792 00000100:00100000:0.0:1789061976.850660:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120353792 00000100:00100000:1.0:1789061976.850669:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120354048 00000100:00100000:1.0:1789061976.850671:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120354048 00000100:00100000:0.0:1789061976.850676:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120354304 00000100:00100000:0.0:1789061976.850678:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120354304 00000100:00100000:0.0:1789061976.850696:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 318 00000100:00100000:0.0:1789061976.850705:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120354176:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061976.850709:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:1.0:1789061976.850714:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120353920:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789061976.850774:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120354176:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 69us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061976.850781:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 318 00000100:00100000:0.0:1789061976.850868:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 319 00000100:00100000:0.0:1789061976.850875:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120353792:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789061976.850901:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 320 00000100:00100000:3.0:1789061976.850912:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120354304:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061976.851444:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120353920:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 726us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061976.851444:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120353792:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 566us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061976.851452:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 319 00000100:00100000:1.0:1789061976.851453:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:1.0:1789061976.851470:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 153 00000100:00100000:1.0:1789061976.851477:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2391:x1875967120354048:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061976.851506:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2391:x1875967120354048:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 31us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061976.851512:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 153 00000100:00100000:3.0:1789061976.852127:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120354304:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1217us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061976.852459:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 320 00000100:00080000:3.0:1789061976.852484:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061976.852489:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789061976.852492:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789061976.852495:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789061976.875110:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061977.897852:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061978.284638:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130884096:0@lo:400:kworker.0 00000100:00100000:3.0:1789061978.284733:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061978.284792:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130884608:0@lo:400:kworker.0 00000100:00100000:3.0:1789061978.284816:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061978.284841:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130885120:0@lo:400:kworker.0 00000100:00100000:3.0:1789061978.284864:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061978.284897:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789061978.284903:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130883968:0@lo:400:kworker.0 00000100:00100000:3.0:1789061978.284932:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061978.284953:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130884480:0@lo:400:kworker.0 00000100:00100000:3.0:1789061978.284978:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061978.284997:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130884992:0@lo:400:kworker.0 00000100:00100000:3.0:1789061978.285021:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061978.285050:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130885504:0@lo:400:kworker.0 00000100:00100000:3.0:1789061978.285071:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061978.285104:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130884480 00000100:00100000:3.0:1789061978.285114:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130884480 00000100:00100000:3.0:1789061978.285173:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789061978.285184:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130884480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061978.285249:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130884480:12345-0@lo:400:kworker.0 Request processed in 66us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061978.285256:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789061978.285305:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130884480:0@lo:400:kworker.0 00000040:00080000:1.0:1789061978.285653:0:13772:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789061978.285667:0:13772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789061978.285762:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1789061978.285769:0:13772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789061978.287118:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130884992 00000100:00100000:1.0:1789061978.287128:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130884992 00000100:00100000:1.0:1789061978.287181:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130885504 00000100:00100000:1.0:1789061978.287184:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130885504 00000100:00100000:1.0:1789061978.287208:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789061978.287218:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130884992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061978.287302:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130884992:12345-0@lo:400:kworker.0 Request processed in 85us (2279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061978.287309:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789061978.287328:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789061978.287333:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130885504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061978.287361:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130885504:12345-0@lo:400:kworker.0 Request processed in 27us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061978.287367:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:3.0:1789061978.292812:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061978.292827:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061978.292907:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130884992:0@lo:400:kworker.0 00000100:00100000:3.0:1789061978.292926:0:3621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789061978.292931:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9766c8170e00, transno 4294967323 00000004:00080000:3.0:1789061978.292962:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1789061978.292991:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130885504:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.293419:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130884096 00000100:00100000:0.0:1789061978.293444:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130884096 00000100:00100000:0.0:1789061978.293496:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130884608 00000100:00100000:0.0:1789061978.293499:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130884608 00000100:00100000:0.0:1789061978.293523:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130885120 00000100:00100000:0.0:1789061978.293525:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130885120 00000100:00100000:0.0:1789061978.293543:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789061978.293552:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130884096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.293682:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130884096:12345-0@lo:400:kworker.0 Request processed in 130us (8949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061978.293689:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789061978.293708:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789061978.293714:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130884608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.293737:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130884608:12345-0@lo:400:kworker.0 Request processed in 24us (8921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061978.293743:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789061978.293751:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789061978.293756:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130885120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.293779:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130885120:12345-0@lo:400:kworker.0 Request processed in 23us (8915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061978.293785:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789061978.294317:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130884224:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.294364:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061978.294395:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130884736:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.294414:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061978.294427:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130885248:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.294442:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061978.294469:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789061978.294475:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130884352:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.294492:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061978.294501:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130884864:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.294518:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061978.294534:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130885376:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.294549:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061978.294579:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130884736 00000100:00100000:0.0:1789061978.294598:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130884736 00000100:00100000:0.0:1789061978.294651:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130885248 00000100:00100000:0.0:1789061978.294654:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130885248 00000100:00100000:0.0:1789061978.294666:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130884352 00000100:00100000:0.0:1789061978.294668:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130884352 00000100:00100000:0.0:1789061978.294679:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789061978.294686:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130884736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.294728:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130884736:12345-0@lo:400:kworker.0 Request processed in 42us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061978.294734:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789061978.294750:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789061978.294756:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130885248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.294782:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130885248:12345-0@lo:400:kworker.0 Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061978.294787:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789061978.294797:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789061978.294802:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130884352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.294827:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130884352:12345-0@lo:400:kworker.0 Request processed in 25us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061978.294842:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789061978.294870:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130883968 00000100:00100000:0.0:1789061978.294875:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130883968 00000100:00100000:0.0:1789061978.294904:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789061978.295101:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130884224 00000100:00100000:2.0:1789061978.295106:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130884224 00000100:00100000:2.0:1789061978.295140:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789061978.295149:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130884224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061978.295194:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130884224:12345-0@lo:400:kworker.0 Request processed in 47us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061978.295199:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789061978.297040:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130883968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.297131:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9aff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3621:x1875967130883968:12345-0@lo:400:kworker.0 Request processed in 2220us (12197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061978.297142:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789061978.297244:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130884352:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.297261:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130884224:0@lo:400:kworker.0 00010000:00080000:0.0:1789061978.297277:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c83a6d80 x1875967130884736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061978.297289:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130884736:0@lo:400:kworker.0 00010000:00080000:0.0:1789061978.297301:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c83a6680 x1875967130885248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061978.297310:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130885248:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.298033:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130884864 00000100:00100000:0.0:1789061978.298044:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130884864 00000100:00100000:0.0:1789061978.298099:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130885376 00000100:00100000:0.0:1789061978.298102:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130885376 00000100:00100000:0.0:1789061978.298124:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789061978.298132:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130884864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.298187:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130884864:12345-0@lo:400:kworker.0 Request processed in 55us (3667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061978.298203:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789061978.298217:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789061978.298223:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130885376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.298251:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130885376:12345-0@lo:400:kworker.0 Request processed in 28us (3701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061978.298256:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789061978.298285:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130884864:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.298297:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130885376:0@lo:400:kworker.0 00000100:00080000:0.0:1789061978.298324:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061978.298329:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789061978.298331:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789061978.298335:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061978.298362:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3621:1875967130883968:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.298376:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130884096:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.298388:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130884608:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.298400:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130885120:0@lo:400:kworker.0 00000100:00100000:0.0:1789061978.412187:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061978.412299:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120354432 00000100:00100000:2.0:1789061978.412311:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120354432 00000100:00100000:2.0:1789061978.412403:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 254 00000100:00100000:2.0:1789061978.412430:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:12125:x1875967120354432:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789061978.412562:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:12125:x1875967120354432:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 133us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061978.412570:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 254 00000100:00080000:0.0:1789061978.412930:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061978.416227:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061978.416325:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120354560 00000100:00100000:1.0:1789061978.416337:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120354560 00000100:00100000:1.0:1789061978.416418:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 255 00000100:00100000:1.0:1789061978.416430:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:12125:x1875967120354560:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789061978.416572:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:12125:x1875967120354560:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 145us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061978.416590:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 255 00000100:00080000:0.0:1789061978.416734:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061978.419741:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061978.419865:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120354816 00000100:00100000:3.0:1789061978.419878:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120354816 00000100:00100000:3.0:1789061978.420430:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:3.0:1789061978.420449:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:12125:x1875967120354816:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789061978.421666:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:12125:x1875967120354816:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 1216us (1933us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789061978.428776:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:2.0:1789061978.794097:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061978.794129:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130885632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789061978.794223:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061978.794314:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130885632 00000100:00100000:2.0:1789061978.794322:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130885632 00000100:00100000:2.0:1789061978.794382:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789061978.794392:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130885632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789061978.794428:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789061978.794481:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130885632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061978.794489:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789061978.794565:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130885632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061978.794758:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789061978.794770:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130885760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061978.794806:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061978.794851:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130885760 00000100:00100000:0.0:1789061978.794872:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130885760 00000100:00100000:0.0:1789061978.794909:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789061978.794917:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130885760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789061978.794944:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789061978.794985:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130885760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061978.794992:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789061978.795028:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130885760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789061978.795732:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061978.795746:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c3066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130885888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789061978.795793:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061978.796010:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130885888 00000100:00100000:3.0:1789061978.796030:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130885888 00000100:00100000:3.0:1789061978.796075:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789061978.796083:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130885888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789061978.796102:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789061978.796158:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130885888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061978.796165:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789061978.796245:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c3066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130885888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789061978.921928:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789061978.989720:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789061979.950439:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789061980.168580:0:14931:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 13:39:37 (1789061977) 00010000:00010000:2.0:1789061980.986075:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061981.354069:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061981.354101:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c3066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130886016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789061981.354164:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061981.354294:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130886016 00000100:00100000:3.0:1789061981.354303:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130886016 00000100:00100000:3.0:1789061981.354368:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789061981.354377:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130886016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789061981.354407:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789061981.354465:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130886016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061981.354472:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789061981.354514:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c3066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130886016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061981.866829:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061981.866853:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130886144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789061981.866923:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061981.867052:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130886144 00000100:00100000:2.0:1789061981.867061:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130886144 00000100:00100000:2.0:1789061981.867124:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789061981.867141:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130886144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789061981.867182:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789061981.867227:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130886144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061981.867234:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789061981.867383:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130886144:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789061981.867512:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061981.867668:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130886272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789061981.867702:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061981.868022:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130886272 00000100:00100000:1.0:1789061981.868028:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130886272 00000100:00100000:1.0:1789061981.868073:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789061981.868081:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130886272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789061981.868093:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061981.868262:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130886272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789061981.868309:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130886272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 229us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061981.868315:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1789061981.868367:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061981.940044:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061981.940355:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120354944 00000100:00100000:0.0:1789061981.940366:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120354944 00000100:00100000:0.0:1789061981.940442:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 256 00000100:00080000:3.0:1789061981.940631:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789061981.940698:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:13152:x1875967120354944:12345-192.168.203.3@tcp:101:lsof.0 00010000:00010000:0.0:1789061981.940717:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789061981.940812:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc780d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bbf3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061981.940945:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc7814 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061981.941020:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc7814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061981.941050:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc7814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789061981.941107:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789061981.941215:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789061981.941254:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc7814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061981.941276:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198400/0x2774d8f311dc780d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbf3 expref: 7 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061981.941293:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc7814 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbf3 expref: 6 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061981.941300:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767f385f100) 00010000:00010000:0.0:1789061981.941303:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061981.941307:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198000, rc 0) 00000100:00100000:0.0:1789061981.941362:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:13152:x1875967120354944:12345-192.168.203.3@tcp:101:lsof.0 Request processed in 669us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061981.944943:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 256 00000100:00100000:1.0:1789061981.958127:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061981.958180:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061981.958203:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061981.958236:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061981.958257:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061981.958282:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061981.958316:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120355328 00000100:00100000:1.0:1789061981.958328:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120355328 00000100:00100000:1.0:1789061981.958390:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120355200 00000100:00100000:1.0:1789061981.958392:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120355200 00000100:00100000:1.0:1789061981.958410:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120355712 00000100:00100000:1.0:1789061981.958412:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120355712 00000100:00100000:1.0:1789061981.958428:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 327 00000100:00100000:1.0:1789061981.958438:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120355328:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061981.958538:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120355328:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 102us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061981.958577:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 327 00000100:00100000:1.0:1789061981.958600:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 328 00000100:00100000:1.0:1789061981.958626:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:2391:x1875967120355200:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061981.958658:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:2391:x1875967120355200:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 53us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061981.958664:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 328 00000100:00100000:1.0:1789061981.958674:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 329 00000100:00100000:1.0:1789061981.958679:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120355712:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061981.958695:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2391:x1875967120355712:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 16us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061981.958701:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 329 00000100:00100000:1.0:1789061981.958717:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120355584 00000100:00100000:1.0:1789061981.958720:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120355584 00000100:00100000:1.0:1789061981.958742:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120355456 00000100:00100000:1.0:1789061981.958744:0:8411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120355456 00000100:00100000:1.0:1789061981.958760:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 158 00000100:00100000:1.0:1789061981.958765:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2391:x1875967120355584:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061981.958788:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2391:x1875967120355584:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061981.958794:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 158 00000100:00100000:1.0:1789061981.958802:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 159 00000100:00100000:1.0:1789061981.958807:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120355456:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061981.958924:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2391:x1875967120355456:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 114us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061981.959210:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120355072 00000100:00100000:0.0:1789061981.959214:0:6491:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120355072 00000100:00100000:1.0:1789061981.959235:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 159 00000100:00080000:1.0:1789061981.959257:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789061981.959261:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061981.959264:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789061981.959266:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789061981.959399:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 388 00000100:00100000:1.0:1789061981.959407:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120355072:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789061981.959569:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+13:2391:x1875967120355072:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 162us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061981.959576:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 388 00010000:00010000:0.0:1789061981.995031:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789061982.900499:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:3.0:1789061982.900532:0:6474:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789061982.901124:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789061982.901139:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1789061983.017934:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061983.335898:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061983.335986:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120355968 00000100:00100000:3.0:1789061983.335995:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120355968 00000100:00100000:3.0:1789061983.336066:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:3.0:1789061983.336077:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+18:13153:x1875967120355968:12345-192.168.203.3@tcp:35:umount.0 00000100:00100000:3.0:1789061983.336372:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:13153:x1875967120355968:12345-192.168.203.3@tcp:35:umount.0 Request processed in 297us (481us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789061983.336381:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00080000:1.0:1789061983.336715:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061983.341130:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061983.341372:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120356224 00000100:00100000:0.0:1789061983.341386:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120356224 00000100:00100000:0.0:1789061983.341530:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:0.0:1789061983.341551:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+19:13153:x1875967120356224:12345-192.168.203.3@tcp:35:umount.0 00000100:00100000:0.0:1789061983.342017:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:13153:x1875967120356224:12345-192.168.203.3@tcp:35:umount.0 Request processed in 475us (900us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789061983.342050:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:0.0:1789061983.346061:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061983.346224:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120356480 00000100:00100000:1.0:1789061983.346238:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120356480 00000100:00100000:1.0:1789061983.346376:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:1.0:1789061983.346388:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f04050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+20:13153:x1875967120356480:12345-192.168.203.3@tcp:35:umount.0 00000100:00100000:1.0:1789061983.347343:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f04050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:13153:x1875967120356480:12345-192.168.203.3@tcp:35:umount.0 Request processed in 952us (1292us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789061983.347354:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:2.0:1789061983.358722:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789061983.359023:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120356736 00000100:00100000:0.0:1789061983.359231:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120356736 00000100:00100000:0.0:1789061983.359428:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:0.0:1789061983.359439:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:13153:x1875967120356736:12345-192.168.203.3@tcp:35:umount.0 00000100:00100000:0.0:1789061983.360532:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:13153:x1875967120356736:12345-192.168.203.3@tcp:35:umount.0 Request processed in 1090us (1821us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789061983.360543:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:2.0:1789061983.368369:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061983.368486:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061983.369265:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120356992 00000100:00100000:3.0:1789061983.369266:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120356864 00000100:00100000:3.0:1789061983.369281:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120356864 00000100:00100000:1.0:1789061983.369281:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120356992 00000100:00100000:2.0:1789061983.369298:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061983.369373:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:3.0:1789061983.369383:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1789061983.369389:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21c8093b-edf9-482d-a900-a6298c53147f+14:2392:x1875967120356992:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789061983.369398:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21c8093b-edf9-482d-a900-a6298c53147f+14:2392:x1875967120356864:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789061983.369412:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061983.369412:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061983.369445:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c74db400/0x2774d8f311dc673c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b70e expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061983.369446:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c74da600/0x2774d8f311dc67f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b74d expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061983.369471:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789061983.369479:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061983.369543:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21c8093b-edf9-482d-a900-a6298c53147f+12:2392:x1875967120356864:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 149us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061983.369563:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1789061983.370241:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061983.370241:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21c8093b-edf9-482d-a900-a6298c53147f+11:2392:x1875967120356992:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 851us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061983.370251:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1789061983.370272:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120357504 00000100:00100000:2.0:1789061983.370276:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120357376 00000100:00100000:1.0:1789061983.370276:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120357504 00000100:00100000:2.0:1789061983.370280:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120357376 00000100:00100000:2.0:1789061983.370384:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:2.0:1789061983.370394:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+7:2389:x1875967120357376:12345-192.168.203.3@tcp:9:umount.0 00000020:00000080:2.0:1789061983.370425:0:8613:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6d8d 00000020:00010000:2.0:1789061983.370499:0:8613:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9767c8f62800: total 0 00000100:00080000:2.0:1789061983.370505:0:8613:0:(import.c:65:import_set_state_nolock()) ffff9767c8f64800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789061983.370577:0:8613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789061983.370773:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2389:x1875967120357376:12345-192.168.203.3@tcp:9:umount.0 Request processed in 381us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061983.370780:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00000020:00010000:2.0:1789061983.370799:0:6483:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9767c8f62800: total 0 00010000:00010000:2.0:1789061983.370824:0:6483:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9767c8f62800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789061983.370892:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdadce1f/0x2774d8f311dc7145 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba10 expref: 4 pid: 8413 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061983.370949:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9b98a85/0x2774d8f311dc7806 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbec expref: 3 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061983.370967:0:6483:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9767c8f62800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789061983.370981:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061983.370982:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061983.370984:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789061983.373052:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:0.0:1789061983.373091:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21c8093b-edf9-482d-a900-a6298c53147f+11:2392:x1875967120357504:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789061983.373116:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789061983.373143:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c80cfc00/0x2774d8f311dc6a4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b826 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.373164:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789061983.373242:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21c8093b-edf9-482d-a900-a6298c53147f+10:2392:x1875967120357504:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 167us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061983.373249:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00080000:3.0:1789061983.373990:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061983.380682:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061983.380753:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120357632 00000100:00100000:1.0:1789061983.380767:0:8412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120357632 00000100:00080000:0.0:1789061983.380848:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789061983.380855:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:1.0:1789061983.380869:0:8412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2389:x1875967120357632:12345-192.168.203.3@tcp:9:umount.0 00000020:00000080:1.0:1789061983.380908:0:8412:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6b17 00000100:00080000:1.0:1789061983.380920:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9766c809b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789061983.380999:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:0.0:1789061983.381042:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061983.381216:0:8412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+2:2389:x1875967120357632:12345-192.168.203.3@tcp:9:umount.0 Request processed in 350us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061983.381225:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:0.0:1789061983.394192:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061983.394342:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120358656 00000100:00100000:1.0:1789061983.394356:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120358656 00000100:00100000:1.0:1789061983.394438:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 257 00000100:00100000:1.0:1789061983.394451:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+22:2389:x1875967120358656:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:1.0:1789061983.394499:0:6497:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc674a 00000020:00010000:1.0:1789061983.394521:0:6497:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9767fd65e800: total 0 00000100:00080000:1.0:1789061983.394527:0:6497:0:(import.c:65:import_set_state_nolock()) ffff9766c572f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789061983.394568:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1789061983.394794:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8b387fcf-29cb-4ebc-866a-7eab61aa3868+21:2389:x1875967120358656:12345-192.168.203.3@tcp:39:umount.0 Request processed in 345us (1055us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1789061983.394826:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 257 00000020:00010000:0.0:1789061983.395499:0:6484:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9767fd65e800: total 0 00010000:00010000:0.0:1789061983.395578:0:6484:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9767fd65e800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789061983.395651:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:0.0:1789061983.395656:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789061983.395677:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b800/0x2774d8f311dc7130 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba09 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.395700:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061983.395703:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789061983.395707:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ac00/0x2774d8f311dc6de8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b929 expref: 19 pid: 10077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.395722:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:0.0:1789061983.395724:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061983.395729:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807aa00/0x2774d8f311dc77c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbd7 expref: 18 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.395742:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c7417500) 00010000:00010000:0.0:1789061983.395745:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789061983.395748:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c3798200/0x2774d8f311dc6a92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b83b expref: 17 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.395769:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:0.0:1789061983.395772:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789061983.395775:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198a00/0x2774d8f311dc77f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbe5 expref: 16 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.395789:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:0.0:1789061983.395791:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789061983.395795:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b600/0x2774d8f311dc74a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb05 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.395814:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767f385f100) 00010000:00010000:0.0:1789061983.395824:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061983.395830:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199e00/0x2774d8f311dc71a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba25 expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.395851:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9767f385f000) 00010000:00010000:0.0:1789061983.395853:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789061983.395856:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a000/0x2774d8f311dc76e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bb9f expref: 13 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.399783:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:0.0:1789061983.399796:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789061983.399814:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807bc00/0x2774d8f311dc7026 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9c3 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.399848:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9767c72b9800) 00010000:00010000:0.0:1789061983.399851:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789061983.399855:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cea00/0x2774d8f311dc6a76 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b834 expref: 11 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.400410:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9767d1235700) 00010000:00010000:0.0:1789061983.400416:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789061983.400422:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc71bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3ba2c expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.400443:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9766c7415e00) 00010000:00010000:0.0:1789061983.400445:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789061983.400450:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc6aed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b850 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.400498:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9766c7415200) 00010000:00010000:0.0:1789061983.400500:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789061983.400505:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7106 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b9fb expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061983.400521:0:6484:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9767fd65e800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789061983.400574:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061983.400578:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061983.400581:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061983.408157:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130886400:0@lo:400:kworker.0 00000100:00100000:0.0:1789061983.408205:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130886784:0@lo:400:kworker.0 00000100:00100000:1.0:1789061983.409029:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130886528:0@lo:400:kworker.0 00000100:00100000:0.0:1789061983.409288:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061983.409355:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130886784 00000100:00100000:3.0:1789061983.409366:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130886784 00000100:00100000:0.0:1789061983.409378:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130887296:0@lo:400:kworker.0 00000100:00100000:0.0:1789061983.409416:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061983.409436:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789061983.409444:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130887808:0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.409450:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130886784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061983.409472:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061983.409498:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789061983.409507:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130887424:0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.409517:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130886784:12345-0@lo:400:kworker.0 Request processed in 70us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061983.409526:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789061983.409537:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061983.409573:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130887936:0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.409585:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130887296 00000100:00100000:3.0:1789061983.409590:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130887296 00000100:00100000:0.0:1789061983.409601:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061983.409649:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130887808 00000100:00100000:0.0:1789061983.409670:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130886784:0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.409673:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130887808 00000100:00100000:3.0:1789061983.409695:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130887424 00000100:00100000:3.0:1789061983.409698:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130887424 00000100:00080000:0.0:1789061983.409711:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061983.409713:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130887936 00000100:00100000:3.0:1789061983.409717:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130887936 00000100:00080000:0.0:1789061983.409718:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789061983.409736:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789061983.409746:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130887296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.409757:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789061983.409767:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130887808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.409816:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130887808:12345-0@lo:400:kworker.0 Request processed in 50us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061983.409820:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130887296:12345-0@lo:400:kworker.0 Request processed in 74us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061983.409942:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789061983.409951:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789061983.409962:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789061983.409971:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130887424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061983.409977:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789061983.409987:0:8411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130887936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.410010:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130887424:12345-0@lo:400:kworker.0 Request processed in 40us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061983.410017:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789061983.410043:0:8411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130887936:12345-0@lo:400:kworker.0 Request processed in 57us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061983.410051:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:0.0:1789061983.410072:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789061983.410090:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130886656:0@lo:400:kworker.0 00000100:00100000:0.0:1789061983.410093:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130887424:0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.410128:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061983.410148:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130887168:0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.410169:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061983.410186:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130887680:0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.410206:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061983.410350:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130887936:0@lo:400:kworker.0 00000100:00100000:0.0:1789061983.410360:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130887296:0@lo:400:kworker.0 00000100:00100000:0.0:1789061983.410369:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130887808:0@lo:400:kworker.0 00000100:00100000:0.0:1789061983.410399:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130886656 00000100:00100000:0.0:1789061983.410404:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130886656 00000100:00100000:3.0:1789061983.410425:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130887168 00000100:00100000:3.0:1789061983.410431:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130887168 00000100:00100000:0.0:1789061983.410443:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789061983.410452:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130886656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.410472:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130887680 00000100:00100000:3.0:1789061983.410476:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130887680 00000100:00100000:0.0:1789061983.410499:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130886656:12345-0@lo:400:kworker.0 Request processed in 48us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061983.410504:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789061983.410511:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789061983.410516:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130887168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061983.410558:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130886656:0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.410581:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875967130887168:12345-0@lo:400:kworker.0 Request processed in 67us (408us total) trans 0 rc 0/0 00010000:00080000:0.0:1789061983.410588:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6768e00 x1875967130887168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061983.410591:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789061983.410631:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789061983.410640:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130887680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.410674:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130887680:12345-0@lo:400:kworker.0 Request processed in 36us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061983.410682:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789061983.410682:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875967130887168:0@lo:400:kworker.0 00010000:00080000:0.0:1789061983.410710:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6768000 x1875967130887680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789061999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061983.410719:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130887680:0@lo:400:kworker.0 00000100:00080000:0.0:1789061983.410741:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789061983.411136:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061983.411227:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130886912:0@lo:400:kworker.0 00000100:00100000:2.0:1789061983.411274:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061983.411358:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061983.411394:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130887040:0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.411410:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130886912 00000100:00100000:3.0:1789061983.411416:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130886912 00000100:00100000:1.0:1789061983.411417:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061983.411435:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130887552:0@lo:400:kworker.0 00000100:00100000:3.0:1789061983.411445:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789061983.411452:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f86c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130886912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061983.411454:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061983.411482:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130886528 00000100:00100000:1.0:1789061983.411486:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130886528 00000100:00100000:3.0:1789061983.411502:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f86c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130886912:12345-0@lo:400:kworker.0 Request processed in 51us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061983.411508:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789061983.411510:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130887040 00000100:00100000:1.0:1789061983.411512:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130887040 00000100:00100000:1.0:1789061983.411532:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130887552 00000100:00100000:1.0:1789061983.411534:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130887552 00000100:00100000:1.0:1789061983.411557:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789061983.411562:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130886528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061983.411595:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130886528:12345-0@lo:400:kworker.0 Request processed in 32us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061983.411600:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789061983.411630:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789061983.411636:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130887040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061983.411659:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130887040:12345-0@lo:400:kworker.0 Request processed in 23us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061983.411663:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789061983.411673:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789061983.411677:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130887552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789061983.411709:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130887552:12345-0@lo:400:kworker.0 Request processed in 32us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061983.411715:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789061983.411807:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130886528:0@lo:400:kworker.0 00000100:00100000:1.0:1789061983.411816:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130887040:0@lo:400:kworker.0 00000100:00100000:1.0:1789061983.411825:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130887552:0@lo:400:kworker.0 00000100:00080000:1.0:1789061983.411913:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789061983.412004:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130886912:0@lo:400:kworker.0 00000100:00100000:0.0:1789061983.412633:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130886400 00000100:00100000:0.0:1789061983.412640:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130886400 00000100:00100000:0.0:1789061983.412708:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1789061983.412716:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130886400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061983.412778:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130886400:12345-0@lo:400:kworker.0 Request processed in 63us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061983.412784:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789061983.412857:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130886400:0@lo:400:kworker.0 00000100:00100000:2.0:1789061983.416332:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061983.416451:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120358784 00000100:00100000:1.0:1789061983.416463:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120358784 00000100:00100000:1.0:1789061983.416572:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 258 00000100:00100000:1.0:1789061983.416584:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+5:2389:x1875967120358784:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:1.0:1789061983.416668:0:6498:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6751 00000100:00080000:1.0:1789061983.416688:0:6498:0:(import.c:65:import_set_state_nolock()) ffff9766c717c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789061983.416715:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789061983.416923:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8b387fcf-29cb-4ebc-866a-7eab61aa3868+3:2389:x1875967120358784:12345-192.168.203.3@tcp:39:umount.0 Request processed in 341us (603us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789061983.416932:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 258 00010000:00010000:2.0:1789061983.417019:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789061983.417148:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789061983.914040:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789061983.914080:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c842bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130888064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789061983.914175:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061983.914389:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130888192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789061983.914663:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130888064 00000100:00100000:2.0:1789061983.914668:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061983.914674:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130888064 00000100:00100000:1.0:1789061983.914712:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061983.914736:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c3065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130888320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789061983.914740:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789061983.914751:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130888064:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061983.914771:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789061983.914787:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789061983.914805:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130888320 00000100:00100000:1.0:1789061983.914809:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130888320 00000100:00100000:1.0:1789061983.914837:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789061983.914844:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130888320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789061983.914857:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789061983.914927:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130888320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061983.914935:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789061983.914989:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c3065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130888320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789061983.915442:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130888192 00000100:00100000:0.0:1789061983.915449:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130888192 00000100:00100000:3.0:1789061983.915964:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130888064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1212us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061983.915973:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789061983.916131:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789061983.916142:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130888192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789061983.916178:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789061983.916192:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c842bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130888064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789061983.916218:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130888192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061983.916220:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130888192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789061983.916224:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00010000:00010000:0.0:1789061984.041886:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061985.070364:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061985.506331:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061985.506391:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061985.506469:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061985.506650:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120358912 00000100:00100000:2.0:1789061985.506663:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120358912 00000100:00100000:2.0:1789061985.506749:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120359168 00000100:00100000:2.0:1789061985.506753:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120359168 00000100:00100000:2.0:1789061985.506769:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120359040 00000100:00100000:2.0:1789061985.506771:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120359040 00000100:00100000:2.0:1789061985.506789:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1789061985.506800:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21c8093b-edf9-482d-a900-a6298c53147f+12:2391:x1875967120358912:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061985.506820:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061985.506848:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1483e00/0x2774d8f311dc684d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b762 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061985.506880:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789061985.506951:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21c8093b-edf9-482d-a900-a6298c53147f+11:2391:x1875967120358912:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 153us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061985.506959:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1789061985.506980:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1789061985.506986:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c6298450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21c8093b-edf9-482d-a900-a6298c53147f+10:2391:x1875967120359168:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789061985.506995:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789061985.507005:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc6a45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b81f expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061985.507016:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061985.507026:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1789061985.507036:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c6298450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21c8093b-edf9-482d-a900-a6298c53147f+9:2391:x1875967120359168:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 49us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061985.507042:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21c8093b-edf9-482d-a900-a6298c53147f+9:2391:x1875967120359040:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789061985.507049:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00010000:00010000:1.0:1789061985.507057:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061985.507070:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1482600/0x2774d8f311dc6854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b793 expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061985.507083:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061985.507111:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:21c8093b-edf9-482d-a900-a6298c53147f+7:2391:x1875967120359040:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 77us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061985.507118:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1789061985.523735:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789061985.525111:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120359424 00000100:00100000:3.0:1789061985.525129:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120359424 00000100:00100000:3.0:1789061985.525239:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 259 00000100:00100000:3.0:1789061985.525252:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+6:2389:x1875967120359424:12345-192.168.203.3@tcp:39:umount.0 00000100:00080000:0.0:1789061985.525438:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1789061985.525876:0:6497:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6862 00000020:00010000:3.0:1789061985.525888:0:6497:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9766c754f800: total 0 00000100:00080000:3.0:1789061985.525894:0:6497:0:(import.c:65:import_set_state_nolock()) ffff9766c754a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789061985.525933:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00010000:2.0:1789061985.526670:0:6483:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9766c754f800: total 0 00010000:00010000:2.0:1789061985.526676:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061985.526756:0:6483:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9766c754f800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789061985.526797:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767f385f100) 00010000:00010000:2.0:1789061985.526817:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789061985.526831:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8198000/0x2774d8f311dc7814 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bbf3 expref: 5 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061985.526864:0:6483:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9766c754f800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789061985.526891:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061985.526893:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061985.526894:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061985.527944:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a8bf6189-9e16-4d60-bea6-060afd49ee07+3:2389:x1875967120359424:12345-192.168.203.3@tcp:39:umount.0 Request processed in 2686us (4216us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1789061985.527957:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 259 00000100:00100000:0.0:1789061985.547743:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789061985.548494:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120359552 00000100:00100000:2.0:1789061985.548508:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120359552 00000100:00100000:2.0:1789061985.548665:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 260 00000100:00100000:2.0:1789061985.548678:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+5:2389:x1875967120359552:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:2.0:1789061985.548731:0:10077:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6869 00000100:00080000:2.0:1789061985.548742:0:10077:0:(import.c:65:import_set_state_nolock()) ffff9766c754e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789061985.548772:0:10077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789061985.548985:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a8bf6189-9e16-4d60-bea6-060afd49ee07+3:2389:x1875967120359552:12345-192.168.203.3@tcp:39:umount.0 Request processed in 309us (1255us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789061985.548993:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 260 00010000:00010000:1.0:1789061985.549574:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789061985.549813:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789061985.600203:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789061985.600387:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120359808 00000100:00100000:1.0:1789061985.600407:0:6488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120359808 00000100:00100000:1.0:1789061985.600502:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 390 00000100:00100000:1.0:1789061985.600513:0:6488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+7:2389:x1875967120359808:12345-192.168.203.3@tcp:251:umount.0 00000020:00000080:1.0:1789061985.600598:0:6488:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6727 00000020:00010000:1.0:1789061985.600660:0:6488:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9767fd65c000: total 0 00000100:00080000:1.0:1789061985.600666:0:6488:0:(import.c:65:import_set_state_nolock()) ffff9767fd65a800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789061985.600779:0:6488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:21c8093b-edf9-482d-a900-a6298c53147f+3:2389:x1875967120359808:12345-192.168.203.3@tcp:251:umount.0 Request processed in 268us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061985.600808:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 390 00000020:00010000:0.0:1789061985.601784:0:6484:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9767fd65c000: total 0 00010000:00010000:0.0:1789061985.601872:0:6484:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9767fd65c000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789061985.601928:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc6800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3b754 expref: 2 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061985.601946:0:6484:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9767fd65c000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789061985.601956:0:6484:0:(genops.c:885:class_export_put()) final put ffff9767fd65c000/21c8093b-edf9-482d-a900-a6298c53147f 00010000:00010000:0.0:1789061985.601978:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061985.601981:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061985.601982:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789061985.602085:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd65c000/21c8093b-edf9-482d-a900-a6298c53147f for MGS 00000020:00000080:2.0:1789061985.602138:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fd65a800 for MGS 00010000:00010000:0.0:1789061986.092011:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061986.476630:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789061986.476662:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c3067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130888448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789061986.476756:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061986.477176:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130888448 00000100:00100000:3.0:1789061986.477188:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130888448 00000100:00100000:3.0:1789061986.477252:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789061986.477264:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130888448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789061986.477311:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789061986.477375:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130888448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061986.477382:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789061986.477449:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c3067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130888448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789061986.985825:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789061986.985858:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c3067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130888576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789061986.985961:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061986.986047:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130888576 00000100:00100000:3.0:1789061986.986057:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130888576 00000100:00100000:3.0:1789061986.986127:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789061986.986157:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130888576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789061986.986199:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061986.986255:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130888576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061986.986262:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1789061986.986288:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789061986.986347:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c3067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130888576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789061986.986799:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061986.986811:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130888704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061986.986852:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061986.986974:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130888704 00000100:00100000:0.0:1789061986.986980:0:8414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130888704 00000100:00100000:0.0:1789061986.987025:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789061986.987032:0:8414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130888704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789061986.987046:0:8414:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789061986.987083:0:8414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130888704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061986.987090:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789061986.987121:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130888704:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789061986.987177:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789061987.117924:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789061987.500355:0:15126:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789061987.536695:0:15126:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789061987.536777:0:15126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.536821:0:15126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.536829:0:15126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.536837:0:15126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.536862:0:15126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789061987.536869:0:15126:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789061987.536905:0:15126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789061987.536912:0:15126:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789061987.536920:0:15126:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789061987.536953:0:15126:0:(import.c:65:import_set_state_nolock()) ffff9767f7eae800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789061987.537062:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c842b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875967130888832:0@lo:39:umount.0 00000100:00100000:3.0:1789061987.537143:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789061987.537295:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789061987.537304:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061987.537314:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c74db200 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:0.0:1789061987.537317:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061987.537327:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789061987.537343:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789061987.537350:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789061987.537353:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789061987.537357:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789061987.537390:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061987.537397:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789061987.537429:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061987.537436:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c74db200/0x2774d8f311dc67cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc67d6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061987.537451:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061987.537453:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061987.537455:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061987.537578:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061987.537592:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130888960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061987.537764:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130888832 00000100:00100000:2.0:1789061987.537775:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130888832 00000100:00100000:2.0:1789061987.538008:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789061987.538020:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875967130888832:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789061987.538055:0:6498:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc634c 00000100:00080000:2.0:1789061987.538070:0:6498:0:(import.c:65:import_set_state_nolock()) ffff9767f4535800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789061987.538181:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3619:x1875967130888832:12345-0@lo:39:umount.0 Request processed in 162us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061987.538188:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789061987.538197:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1789061987.538206:0:6498:0:(genops.c:885:class_export_put()) final put ffff9767f4533800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1789061987.538360:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789061987.538584:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767f7eae800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789061987.538619:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c842b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875967130888832:0@lo:39:umount.0 00000100:00100000:1.0:1789061987.539221:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130888960 00000100:00100000:1.0:1789061987.539229:0:6482:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130888960 00000100:00100000:1.0:1789061987.539288:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789061987.539297:0:6482:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3623:x1875967130888960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789061987.539311:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789061987.539330:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0030800/0x2774d8f311dc67d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc67cf expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061987.539346:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789061987.539390:0:6482:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:3623:x1875967130888960:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061987.539397:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789061987.539837:0:15126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789061987.539845:0:15126:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789061987.539875:0:15126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789061987.541883:0:15126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.541907:0:15126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.541915:0:15126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.541922:0:15126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.541966:0:15126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789061987.541974:0:15126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.541981:0:15126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.541988:0:15126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.541995:0:15126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.542025:0:15126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789061987.542035:0:15126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.542042:0:15126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542053:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789061987.542073:0:15126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.542084:0:15126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542086:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542113:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c74db600 already unused, calling callback (ffffffffc14eec20) 00010000:00010000:2.0:1789061987.542118:0:15126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:00010000:3.0:1789061987.542120:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.542130:0:15126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3798c00/0x2774d8f311dc629d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542135:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.542146:0:15126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3798c00/0x2774d8f311dc629d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061987.542151:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.542161:0:15126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3798c00/0x2774d8f311dc629d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061987.542165:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789061987.542176:0:7904:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789061987.542180:0:15126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9767c3798c00/0x2774d8f311dc629d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061987.542190:0:15126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1789061987.542194:0:15126:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:3.0:1789061987.542201:0:7904:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789061987.542320:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542327:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061987.542353:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542361:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c74db600/0x2774d8f311dc67dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc67e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542377:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789061987.542381:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542387:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1482800 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789061987.542390:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542398:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061987.542404:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061987.542409:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789061987.542411:0:7904:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789061987.542413:0:7904:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789061987.542427:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542433:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061987.542457:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542464:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1482800/0x2774d8f311dc66e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc66e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542486:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789061987.542491:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542496:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf400 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789061987.542499:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542507:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061987.542513:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061987.542529:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789061987.542531:0:7904:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789061987.542534:0:7904:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789061987.542547:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542552:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061987.542558:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542563:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc6a37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc6a3e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542583:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061987.542586:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c3798c00/0x2774d8f311dc629d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542592:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3798c00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789061987.542595:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c3798c00/0x2774d8f311dc629d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542602:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c3798c00/0x2774d8f311dc629d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061987.542633:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c3798c00/0x2774d8f311dc629d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061987.542638:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789061987.542640:0:7904:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789061987.542642:0:7904:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789061987.542656:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c3798c00/0x2774d8f311dc629d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542661:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789061987.542668:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c3798c00/0x2774d8f311dc629d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542673:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c3798c00/0x2774d8f311dc629d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc62a4 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.542681:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061987.542683:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061987.543114:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061987.543135:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c3066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130889216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061987.543197:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061987.543651:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789061987.543662:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c3065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130889344:0@lo:103:ldlm_bl.0 00000020:01000004:2.0:1789061987.543684:0:15126:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789061987.543693:0:15126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789061987.543699:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789061987.543707:0:15126:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/15 00000020:00080000:2.0:1789061987.543717:0:15126:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9766c717a000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789061987.543725:0:15126:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9766c56ec800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789061987.543730:0:15126:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9767fb31a800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789061987.543747:0:15126:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9767fd12a800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1789061987.543756:0:15126:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9766c754f800 a8bf6189-9e16-4d60-bea6-060afd49ee07 192.168.203.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789061987.543764:0:15126:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9767fd65e800 8b387fcf-29cb-4ebc-866a-7eab61aa3868 192.168.203.3@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000100:00100000:3.0:1789061987.543780:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789061987.543788:0:15126:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9767fa37b380) has exports, disconnecting them 00000020:00080000:2.0:1789061987.543798:0:15126:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9766c717a000), last request at 1789061983 00000020:00000080:2.0:1789061987.543808:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc664e 00000100:00080000:2.0:1789061987.543839:0:15126:0:(import.c:65:import_set_state_nolock()) ffff9766c7178800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789061987.543851:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130889216 00000100:00100000:3.0:1789061987.543862:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130889216 00000020:00080000:2.0:1789061987.543923:0:15126:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9766c717a000): rc 0 00000020:00000080:2.0:1789061987.543927:0:15126:0:(genops.c:885:class_export_put()) final put ffff9766c717a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789061987.544096:0:15126:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9766c56ec800), last request at 1789061983 00000020:00000080:2.0:1789061987.544100:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc652f 00000100:00080000:2.0:1789061987.544109:0:15126:0:(import.c:65:import_set_state_nolock()) ffff9766c56eb000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789061987.544117:0:15126:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9766c56ec800): rc 0 00000020:00000080:2.0:1789061987.544119:0:15126:0:(genops.c:885:class_export_put()) final put ffff9766c56ec800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789061987.544124:0:15126:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9767fb31a800), last request at 1789061771 00000020:00000080:2.0:1789061987.544128:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6425 00000100:00080000:2.0:1789061987.544133:0:15126:0:(import.c:65:import_set_state_nolock()) ffff9767fb31c000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789061987.544139:0:15126:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9767fb31a800): rc 0 00000020:00000080:2.0:1789061987.544141:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767fb31a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789061987.544149:0:15126:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9767fd12a800), last request at 1789061771 00000100:00100000:3.0:1789061987.544153:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130889344 00000020:00000080:2.0:1789061987.544154:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc63f4 00000100:00100000:3.0:1789061987.544163:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130889344 00000100:00080000:2.0:1789061987.544163:0:15126:0:(import.c:65:import_set_state_nolock()) ffff9767fd130000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789061987.544177:0:15126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:3.0:1789061987.544203:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789061987.544214:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3066300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+24:3620:x1875967130889216:12345-0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789061987.544360:0:15126:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9767fd12a800): rc 0 00000004:00000080:2.0:1789061987.544369:0:15126:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc8841517ae0 00000100:00080000:2.0:1789061987.544394:0:15126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789061987.544396:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c3067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130889088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061987.544407:0:15126:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1789061987.544438:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789061987.544866:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061987.544887:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3798e00/0x2774d8f311dc66e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc66e1 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.545014:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061987.545063:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3066300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:3620:x1875967130889216:12345-0@lo:103:ldlm_bl.0 Request processed in 850us (1865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061987.545146:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130888960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061987.545173:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789061987.545181:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c3065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130889472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789061987.545212:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061987.545302:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789061987.545325:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130889088 00000100:00100000:3.0:1789061987.545329:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130889088 00000100:00100000:3.0:1789061987.545352:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789061987.545359:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3066a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+23:3620:x1875967130889344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789061987.545368:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061987.545378:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc6a3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc6a37 expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.545387:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061987.545423:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3066a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+22:3620:x1875967130889344:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061987.545429:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789061987.545443:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789061987.545449:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+21:3623:x1875967130889088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789061987.545456:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061987.545465:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47b600/0x2774d8f311dc67e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc67dd expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061987.545472:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061987.545493:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:3623:x1875967130889088:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061987.545498:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789061987.545563:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c3065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130889344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061987.545572:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c3066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130889216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789061987.545590:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061987.545806:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061987.545813:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061987.545974:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130889472 00000100:00100000:3.0:1789061987.545979:0:6480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130889472 00000100:00100000:3.0:1789061987.546052:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789061987.546059:0:6480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+20:3623:x1875967130889472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789061987.546081:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789061987.546095:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1482000/0x2774d8f311dc62a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc629d expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789061987.546099:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9767f4533800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1789061987.546107:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789061987.546144:0:6480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:3623:x1875967130889472:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061987.546175:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00000080:0.0:1789061987.546434:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c717a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789061987.546466:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c56ec800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789061987.546503:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb31a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789061987.546539:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767f4535800 for lustre-MDT0000 00000020:00000080:0.0:1789061987.546545:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c7178800 for lustre-MDT0000 00000020:00000080:0.0:1789061987.546549:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c56eb000 for lustre-MDT0000 00000020:00000080:0.0:1789061987.546555:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fb31c000 for lustre-MDT0000 00000100:00100000:3.0:1789061987.547025:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c3065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130889472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061987.547037:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c3067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130889088:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789061987.551095:0:15126:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789061987.551151:0:15126:0:(import.c:65:import_set_state_nolock()) ffff9767fd129800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789061987.551419:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c842ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130889600:0@lo:39:umount.0 00000100:00100000:3.0:1789061987.551525:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061987.551783:0:7866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130889600 00000100:00100000:1.0:1789061987.551794:0:7866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130889600 00000100:00100000:1.0:1789061987.551858:0:7866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789061987.551869:0:7866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875967130889600:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789061987.551907:0:7866:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6480 00000100:00080000:1.0:1789061987.551918:0:7866:0:(import.c:65:import_set_state_nolock()) ffff9767fd136000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789061987.551949:0:7866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1789061987.552118:0:7866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3619:x1875967130889600:12345-0@lo:39:umount.0 Request processed in 251us (600us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789061987.552127:0:7866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00010000:00010000:0.0:1789061987.552185:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789061987.552327:0:15126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789061987.552332:0:15126:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1789061987.552351:0:15126:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789061987.552433:0:15126:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789061987.552449:0:15126:0:(import.c:65:import_set_state_nolock()) ffff9766c1585000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789061987.552456:0:15126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789061987.552458:0:15126:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1789061987.552466:0:15126:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789061987.552652:0:15126:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789061987.552663:0:15126:0:(import.c:65:import_set_state_nolock()) ffff9766c75b7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789061987.552694:0:15126:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9767fa37b380) has no exports 00000100:00100000:3.0:1789061987.553264:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130889728:0@lo:9:umount.0 00000100:00100000:3.0:1789061987.553321:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061987.553359:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c842b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130889856:0@lo:9:umount.0 00000100:00100000:3.0:1789061987.553381:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789061987.553430:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fd129800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789061987.553437:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c842ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130889600:0@lo:39:umount.0 00000100:00100000:2.0:1789061987.553711:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130889728 00000100:00100000:2.0:1789061987.553720:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130889728 00000100:00100000:2.0:1789061987.553767:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130889856 00000100:00100000:2.0:1789061987.553771:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130889856 00000100:00100000:2.0:1789061987.553803:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789061987.553812:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875967130889728:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789061987.553840:0:8613:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc65d0 00000100:00080000:2.0:1789061987.553849:0:8613:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789061987.553892:0:8613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789061987.554038:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3619:x1875967130889728:12345-0@lo:9:umount.0 Request processed in 225us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061987.554046:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789061987.554062:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789061987.554069:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875967130889856:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789061987.554097:0:8613:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6712 00000100:00080000:2.0:1789061987.554104:0:8613:0:(import.c:65:import_set_state_nolock()) ffff9766c7178000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789061987.554127:0:8613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789061987.554198:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3619:x1875967130889856:12345-0@lo:9:umount.0 Request processed in 130us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061987.554205:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789061987.554241:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789061987.554538:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9766c1585000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789061987.554558:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789061987.554561:0:3619:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789061987.554565:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130889728:0@lo:9:umount.0 00000100:00080000:3.0:1789061987.554577:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9766c75b7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789061987.554586:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789061987.554588:0:3619:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789061987.554591:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c842b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130889856:0@lo:9:umount.0 00010000:00010000:1.0:1789061987.554743:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061987.554750:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789061987.562043:0:15126:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9767fa37b380) has no exports 00000020:00000080:2.0:1789061987.633803:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc62f8 00000020:00000080:2.0:1789061987.633820:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767f7e7b000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789061987.633832:0:15126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789061987.634139:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767f7e7b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789061987.634167:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789061987.634177:0:15126:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789061987.634182:0:15126:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9767f7e599c0) has no exports 00000020:00000080:3.0:1789061987.634484:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc62f1 00000020:00000080:3.0:1789061987.634502:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767f454f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789061987.634571:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789061987.634578:0:15126:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789061987.634581:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767f454b800/lustre-QMT0000_UUID 00000020:00000080:3.0:1789061987.634584:0:15126:0:(genops.c:844:class_export_destroy()) destroying export ffff9767f454b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789061987.634588:0:15126:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1789061987.634875:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767f454f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789061988.140044:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789061988.202264:0:13775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789061988.522057:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130890368:0@lo:400:kworker.0 00000100:00100000:2.0:1789061988.522116:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130890112:0@lo:400:kworker.0 00000100:00100000:0.0:1789061988.522137:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061988.522233:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130889984:0@lo:400:kworker.0 00000100:00100000:2.0:1789061988.527289:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061988.527371:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130890624:0@lo:400:kworker.0 00000100:00100000:2.0:1789061988.527426:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061988.527474:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789061988.527481:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130890240:0@lo:400:kworker.0 00000100:00100000:2.0:1789061988.527525:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061988.527550:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130890752:0@lo:400:kworker.0 00000100:00100000:2.0:1789061988.527572:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061988.527702:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130890624 00000100:00100000:2.0:1789061988.527710:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130890624 00000100:00100000:2.0:1789061988.527764:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789061988.527773:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130890624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789061988.527824:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130890624:12345-0@lo:400:kworker.0 Request processed in 51us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789061988.527847:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789061988.527870:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130890368 00000100:00100000:2.0:1789061988.527874:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130890368 00000100:00100000:2.0:1789061988.527895:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130890240 00000100:00100000:2.0:1789061988.527898:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130890240 00000100:00100000:2.0:1789061988.527910:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130890752 00000100:00100000:2.0:1789061988.527913:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130890752 00000100:00100000:2.0:1789061988.527923:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789061988.527928:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3622:x1875967130890368:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789061988.527934:0:10077:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789061988.527966:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3622:x1875967130890368:12345-0@lo:400:kworker.0 Request processed in 36us (5831us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789061988.527972:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789061988.527983:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789061988.527986:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3620:x1875967130890240:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789061988.527990:0:10077:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789061988.528012:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3620:x1875967130890240:12345-0@lo:400:kworker.0 Request processed in 24us (487us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789061988.528017:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789061988.528027:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789061988.528031:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3620:x1875967130890752:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789061988.528034:0:10077:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789061988.528060:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3620:x1875967130890752:12345-0@lo:400:kworker.0 Request processed in 28us (487us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789061988.528066:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1789061988.528081:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789061988.528111:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789061988.528116:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9767fd130800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789061988.528127:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1789061988.529769:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130890112 00000100:00100000:1.0:1789061988.529781:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130890112 00000100:00100000:1.0:1789061988.529827:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789061988.529834:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3620:x1875967130890112:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789061988.529842:0:6502:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789061988.529902:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3620:x1875967130890112:12345-0@lo:400:kworker.0 Request processed in 67us (2620us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789061988.529908:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:0.0:1789061988.532544:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789061988.532552:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789061988.532556:0:3622:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789061988.532562:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789061988.532566:0:3622:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 170 00000100:00080000:0.0:1789061988.532579:0:3622:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9767fd2c5000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1789061988.532636:0:3622:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c81ab480 x1875967130891136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789061988.532685:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130890368:0@lo:400:kworker.0 00000100:00100000:0.0:1789061988.532696:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130890880:0@lo:400:kworker.0 00000100:00100000:0.0:1789061988.533004:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061988.533072:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130890880 00000100:00100000:0.0:1789061988.533079:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130890880 00000100:00100000:0.0:1789061988.533135:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789061988.533143:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130890880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061988.533190:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875967130890880:12345-0@lo:400:kworker.0 Request processed in 48us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061988.533197:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00010000:00080000:0.0:1789061988.533233:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c77a8e00 x1875967130890880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789061988.533244:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875967130890880:0@lo:400:kworker.0 00000100:00080000:0.0:1789061988.533289:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789061988.533392:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061988.533437:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130890496:0@lo:400:kworker.0 00000100:00100000:3.0:1789061988.533461:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061988.533483:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130890496 00000100:00100000:3.0:1789061988.533487:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130890496 00000100:00100000:3.0:1789061988.533530:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789061988.533537:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130890496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061988.533566:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130890496:12345-0@lo:400:kworker.0 Request processed in 30us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061988.533572:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00010000:00080000:3.0:1789061988.533596:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676b100 x1875967130890496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789061988.533621:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130890496:0@lo:400:kworker.0 00000100:00100000:3.0:1789061988.533628:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130891008:0@lo:400:kworker.0 00000100:00100000:3.0:1789061988.533667:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061988.533691:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130891008 00000100:00100000:3.0:1789061988.533694:0:8413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130891008 00000100:00100000:3.0:1789061988.533965:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789061988.533974:0:8413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130891008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789061988.534017:0:8413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130891008:12345-0@lo:400:kworker.0 Request processed in 44us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061988.534024:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789061988.534053:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130891008:0@lo:400:kworker.0 00000100:00100000:1.0:1789061988.534386:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875967130891136:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789061988.534422:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061988.534477:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130891136 00000100:00100000:1.0:1789061988.534481:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130891136 00000100:00100000:1.0:1789061988.534519:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789061988.534525:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875967130891136:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789061988.534548:0:6497:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789061988.537102:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130889984 00000100:00100000:0.0:1789061988.537117:0:6490:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130889984 00000100:00100000:0.0:1789061988.537187:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1789061988.537197:0:6490:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:3623:x1875967130889984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789061988.537278:0:6490:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4c9b030-cc89-4fa3-a2aa-771221619f7d+19:3623:x1875967130889984:12345-0@lo:400:kworker.0 Request processed in 83us (3886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789061988.537285:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00080000:0.0:1789061988.537322:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789061988.537327:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789061988.541026:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130889984:0@lo:400:kworker.0 00000100:00080000:2.0:1789061988.548498:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9767fd130800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789061988.548508:0:3620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 152 00000100:00080000:2.0:1789061988.548531:0:3620:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9767fd130800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789061988.548575:0:3620:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c748d880 x1875967130891264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789061988.548673:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875967130891264:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789061988.548748:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061988.548836:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130891264 00000100:00100000:0.0:1789061988.548844:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130891264 00000100:00100000:0.0:1789061988.548897:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789061988.548905:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875967130891264:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789061988.548921:0:6498:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789061988.549051:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130890240:0@lo:400:kworker.0 00000100:00080000:2.0:1789061988.549075:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789061988.549079:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9767fb28a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789061988.549083:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789061988.549087:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9767fb28a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789061988.549091:0:3620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 190 00000100:00080000:2.0:1789061988.549097:0:3620:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9767fb28a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789061988.549112:0:3620:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c748e300 x1875967130891392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789061988.549218:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875967130891392:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789061988.549245:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061988.549301:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875967130891264:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 394us (552us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789061988.549309:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789061988.549326:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130891392 00000100:00100000:0.0:1789061988.549330:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130891392 00000100:00100000:0.0:1789061988.549346:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789061988.549351:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875967130891392:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789061988.549359:0:6498:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789061988.549382:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875967130891392:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (137us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789061988.549388:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1789061988.549800:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fd130800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789061988.549806:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789061988.549810:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875967130891264:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1789061988.549831:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fb28a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789061988.549834:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789061988.549837:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875967130891392:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789061988.550467:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130890752:0@lo:400:kworker.0 00000100:00080000:2.0:1789061988.550489:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789061988.550493:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9767f7e78000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789061988.550497:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789061988.550502:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9767f7e78000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789061988.550506:0:3620:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 152 00000100:00080000:2.0:1789061988.550526:0:3620:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9767f7e78000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789061988.550562:0:3620:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c748f480 x1875967130891520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789061988.550588:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130890112:0@lo:400:kworker.0 00000100:00100000:2.0:1789061988.550620:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130890624:0@lo:400:kworker.0 00000100:00100000:3.0:1789061988.550787:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130891520:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789061988.550833:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061988.551025:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130891520 00000100:00100000:2.0:1789061988.551032:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130891520 00000100:00100000:2.0:1789061988.551069:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789061988.551076:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875967130891520:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1789061988.551088:0:6501:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789061988.551172:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875967130891520:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 95us (337us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789061988.551180:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1789061988.551284:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767f7e78000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789061988.551291:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789061988.551303:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130891520:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789061988.584977:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875967130891136:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 50440us (50544us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789061988.584991:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1789061988.585465:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789061988.585472:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789061988.585477:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875967130891136:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789061989.036530:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789061989.036558:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130891648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789061989.036651:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061989.036878:0:11983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130891648 00000100:00100000:3.0:1789061989.036888:0:11983:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130891648 00000100:00100000:3.0:1789061989.036937:0:11983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789061989.036953:0:11983:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130891648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789061989.036986:0:11983:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789061989.037052:0:11983:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130891648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061989.037060:0:11983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000001:00100000:3.0:1789061989.037240:0:6474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789061989.037245:0:6474:0:(genops.c:885:class_export_put()) final put ffff9767fd12a800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789061989.037282:0:6474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a8bf6189-9e16-4d60-bea6-060afd49ee07 00000001:00080000:3.0:1789061989.037290:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:3.0:1789061989.037294:0:6474:0:(genops.c:885:class_export_put()) final put ffff9766c754f800/a8bf6189-9e16-4d60-bea6-060afd49ee07 00000001:00100000:3.0:1789061989.037300:0:6474:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000001:00080000:3.0:1789061989.037305:0:6474:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1789061989.037314:0:6474:0:(genops.c:885:class_export_put()) final put ffff9767fd65e800/8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000020:00000080:0.0:1789061989.038410:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd12a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1789061989.038502:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c754f800/a8bf6189-9e16-4d60-bea6-060afd49ee07 for lustre-MDT0000 00000020:00000080:0.0:1789061989.038545:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd65e800/8b387fcf-29cb-4ebc-866a-7eab61aa3868 for lustre-MDT0000 00000020:00000080:0.0:1789061989.038574:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fd130000 for lustre-MDT0000 00000020:00000080:0.0:1789061989.038579:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c754a000 for lustre-MDT0000 00000020:00000080:0.0:1789061989.038583:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c572f800 for lustre-MDT0000 00000001:00100000:2.0:1789061989.039039:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789061989.039047:0:9490:0:(genops.c:885:class_export_put()) final put ffff9766c717f000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789061989.039066:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000020:00000080:2.0:1789061989.039068:0:9490:0:(genops.c:885:class_export_put()) final put ffff9767c8f62800/8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000020:00000080:2.0:1789061989.039087:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c717f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789061989.039136:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9767c8f62800/8b387fcf-29cb-4ebc-866a-7eab61aa3868 for lustre-OST0001 00000020:00000080:2.0:1789061989.039157:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c7178000 for lustre-OST0001 00000020:00000080:2.0:1789061989.039163:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767c8f64800 for lustre-OST0001 00000100:00100000:1.0:1789061989.039293:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130891648:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1789061989.041015:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789061989.041027:0:8406:0:(genops.c:885:class_export_put()) final put ffff9767fd2c1000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789061989.041060:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000020:00000080:0.0:1789061989.041063:0:8406:0:(genops.c:885:class_export_put()) final put ffff9766c809b800/8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000020:00000080:2.0:1789061989.043897:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd2c1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789061989.043957:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c809b800/8b387fcf-29cb-4ebc-866a-7eab61aa3868 for lustre-OST0000 00000020:00000080:2.0:1789061989.043975:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fd2c7800 for lustre-OST0000 00000020:00000080:2.0:1789061989.043980:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c809b000 for lustre-OST0000 00000001:00100000:3.0:1789061989.047797:0:7427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789061989.047818:0:7427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789061989.047826:0:7427:0:(genops.c:885:class_export_put()) final put ffff9767fd2c2800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789061989.047851:0:7427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a8bf6189-9e16-4d60-bea6-060afd49ee07 00000001:00080000:3.0:1789061989.047858:0:7427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1789061989.047861:0:7427:0:(genops.c:885:class_export_put()) final put ffff9766c7548000/a8bf6189-9e16-4d60-bea6-060afd49ee07 00000001:00100000:3.0:1789061989.047866:0:7427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000001:00080000:3.0:1789061989.047870:0:7427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1789061989.047872:0:7427:0:(genops.c:885:class_export_put()) final put ffff9766c717b000/8b387fcf-29cb-4ebc-866a-7eab61aa3868 00000020:00000080:0.0:1789061989.047958:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd2c2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789061989.048033:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c7548000/a8bf6189-9e16-4d60-bea6-060afd49ee07 for lustre-MDT0001 00000020:00000080:0.0:1789061989.048062:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c717b000/8b387fcf-29cb-4ebc-866a-7eab61aa3868 for lustre-MDT0001 00000020:00000080:0.0:1789061989.048090:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fd136000 for lustre-MDT0001 00000020:00000080:0.0:1789061989.048095:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c754e000 for lustre-MDT0001 00000020:00000080:0.0:1789061989.048099:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c717c800 for lustre-MDT0001 00010000:00010000:1.0:1789061989.161773:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789061989.673791:0:15126:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9766c6070ba0 - data ffff9766c5813510/ffff9766c674a800 00000020:01000000:3.0:1789061989.674024:0:15126:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9767c9f185a0 - data ffff9767ebd88a20/ffff9767fb02ec00 00000001:00000004:3.0:1789061989.688665:0:15126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:1.0:1789061989.749631:0:15126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789061989.749644:0:15126:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1789061989.749661:0:15126:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9766c842ad80 x1875967130889600/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789061997 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789061989.749707:0:15126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789061989.755133:0:15126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789061989.755145:0:15126:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1789061989.755172:0:15126:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789061989.755175:0:15126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789061989.755450:0:8611:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789061989.755458:0:8611:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789061989.755483:0:8611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789061989.756445:0:15126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789061989.756453:0:15126:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1789061989.756812:0:15126:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789061989.756815:0:15126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789061989.757074:0:9803:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789061989.757080:0:9803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1789061989.757104:0:9803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789061989.759347:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc62c0 00000020:00000080:0.0:1789061989.759361:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767c3f7d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789061989.760077:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767c3f7d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789061989.768373:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc62d5 00000020:00000080:0.0:1789061989.768392:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767df9c5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789061989.768411:0:15126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789061989.768417:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061989.768428:0:15126:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789061989.768434:0:15126:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9767fa3799c0) has no exports 00000020:00000080:2.0:1789061989.768470:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767df9c5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1789061989.768693:0:15126:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789061989.768705:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc670b 00000020:00000080:0.0:1789061989.768710:0:15126:0:(genops.c:885:class_export_put()) final put ffff9766c717c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789061989.768726:0:15126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789061989.768730:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061989.768741:0:15126:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789061989.768745:0:15126:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff9766c71e4d40) has no exports 00000020:00000080:0.0:1789061989.768753:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6704 00000020:00000080:0.0:1789061989.768759:0:15126:0:(genops.c:885:class_export_put()) final put ffff9766c75b0000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789061989.768801:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c717c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789061989.768814:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c75b0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789061989.769231:0:15126:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789061989.769237:0:15126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789061989.769243:0:15126:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1789061989.769250:0:15126:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789061989.769253:0:15126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789061989.769310:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789061989.769315:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c75b7000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789061989.769320:0:15126:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789061989.769326:0:36:0:(genops.c:885:class_export_put()) final put ffff9766c75b7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789061989.769329:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc65c9 00000020:00000080:2.0:1789061989.769330:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c75b7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789061989.769336:0:15126:0:(genops.c:885:class_export_put()) final put ffff9766c572b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789061989.769339:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789061989.769350:0:15126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789061989.769355:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061989.769360:0:15126:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789061989.769363:0:15126:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9767f7e58000) has no exports 00000020:00000080:0.0:1789061989.769368:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc65c2 00000020:00000080:0.0:1789061989.769371:0:15126:0:(genops.c:885:class_export_put()) final put ffff9766c1586800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789061989.769463:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c572b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789061989.769475:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c1586800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789061989.769860:0:15126:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789061989.769864:0:15126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789061989.769867:0:15126:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1789061989.769871:0:15126:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789061989.769873:0:15126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789061989.769916:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061989.769928:0:15126:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1789061989.769941:0:15126:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789061989.769954:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6479 00000020:00000080:0.0:1789061989.769959:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767fd12d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789061989.769963:0:15126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1789061989.769966:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061989.769971:0:15126:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789061989.769974:0:15126:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9767f7e5cd40) has no exports 00000020:00000080:1.0:1789061989.769978:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c1585000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789061989.769980:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6472 00000020:00000080:0.0:1789061989.769986:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767fd128000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789061989.769990:0:37:0:(genops.c:885:class_export_put()) final put ffff9766c1580000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789061989.769994:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c1580000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789061989.770005:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789061989.770087:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd12d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789061989.770097:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd128000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789061989.796341:0:15126:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789061989.796354:0:15126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789061989.796361:0:15126:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789061989.796374:0:15126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789061989.796468:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789061989.796482:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fd129800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789061989.796488:0:15126:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789061989.796498:0:36:0:(genops.c:885:class_export_put()) final put ffff9767fd12d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789061989.796513:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd12d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1789061989.796539:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789061989.796545:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061989.796552:0:15126:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789061989.796557:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767c3f79800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789061989.796561:0:15126:0:(genops.c:844:class_export_destroy()) destroying export ffff9767c3f79800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789061989.796571:0:15126:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789061989.796757:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc62dc 00000020:00000080:0.0:1789061989.796766:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767df9c5000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789061989.796850:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767df9c5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789061989.796850:0:15126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789061989.796857:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061989.796864:0:15126:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789061989.796869:0:15126:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9767fa37cd40) has no exports 00000020:00000080:0.0:1789061989.796897:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061989.796901:0:15126:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789061989.796905:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767c3f7c800/lustre-MDD0000_UUID 00000020:00000080:0.0:1789061989.796907:0:15126:0:(genops.c:844:class_export_destroy()) destroying export ffff9767c3f7c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789061989.796913:0:15126:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789061989.796949:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc62e3 00000020:00000080:0.0:1789061989.796956:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767df9c7000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789061989.798714:0:15126:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767c3163000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789061989.798725:0:15126:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767c3163000 3 00000020:01000004:0.0:1789061989.798730:0:15126:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9767c3163000 from lustre-MDT0000 00000020:00000080:0.0:1789061989.798772:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061989.799078:0:15126:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789061989.799085:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767c3f7e800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789061989.799090:0:15126:0:(genops.c:844:class_export_destroy()) destroying export ffff9767c3f7e800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789061989.799101:0:15126:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789061989.799192:0:15126:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:00000080:2.0:1789061989.799302:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767df9c7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1789061989.799311:0:15126:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789061989.799317:0:15126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789061989.799322:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061989.799327:0:15126:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789061989.799336:0:15126:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9767c3f64800 c4c9b030-cc89-4fa3-a2aa-771221619f7d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789061989.799344:0:15126:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9767f3834d40) has exports, disconnecting them 00000020:00080000:0.0:1789061989.799350:0:15126:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9767c3f64800), last request at 1789061753 00000020:00000080:0.0:1789061989.799372:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6281 00000020:00010000:0.0:1789061989.799379:0:15126:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9767c3f64800: total 0 00000100:00080000:0.0:1789061989.799385:0:15126:0:(import.c:65:import_set_state_nolock()) ffff9767c3f63000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789061989.799409:0:15126:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9767c3f64800): rc 0 00000020:00080000:0.0:1789061989.799416:0:15126:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9767f3834d40) has no exports 00000100:00100000:0.0:1789061989.799520:0:6490:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9767c6f55c00:6490] 1 exiting: rc = 0 00000100:00100000:3.0:1789061989.799529:0:6488:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff976801cdae00:6488] 0 exiting: rc = 1 00000100:00100000:2.0:1789061989.799651:0:6491:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9767d80ee600:6491] 2 exiting: rc = 0 00000020:00010000:1.0:1789061989.799702:0:6484:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9767c3f64800: total 0 00010000:00010000:1.0:1789061989.799757:0:6484:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9767c3f64800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789061989.799796:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3798600/0x2774d8f311dc6a22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc6a1b expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799817:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47aa00/0x2774d8f311dc67c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc67c1 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799828:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3798400/0x2774d8f311dc637d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc6376 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799844:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3798800/0x2774d8f311dc638b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc6384 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799856:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c3799c00/0x2774d8f311dc6a14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc6a0d expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799868:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c74db000/0x2774d8f311dc67f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc67eb expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799879:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c74dae00/0x2774d8f311dc6782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc677b expref: 8 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799890:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c80cfe00/0x2774d8f311dc6a30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc6a29 expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799904:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47a400/0x2774d8f311dc66a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc669b expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799916:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031000/0x2774d8f311dc679e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc6797 expref: 5 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799946:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47b000/0x2774d8f311dc6790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc6789 expref: 4 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799957:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc67ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc67b3 expref: 3 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799967:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c74da000/0x2774d8f311dc67ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2774d8f311dc67a5 expref: 2 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061989.799979:0:6484:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9767c3f64800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789061989.799996:0:6484:0:(genops.c:885:class_export_put()) final put ffff9767c3f64800/c4c9b030-cc89-4fa3-a2aa-771221619f7d 00010000:00010000:1.0:1789061989.800011:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061989.800014:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061989.800016:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789061989.800693:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800705:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800712:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800718:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800723:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800729:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800734:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800741:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800750:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800757:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800763:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800769:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800776:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800783:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800792:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800798:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800805:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800820:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800827:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800834:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800840:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800846:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800854:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800860:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800868:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800874:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800879:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800884:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800889:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800894:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800900:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800905:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800912:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800918:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800924:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800930:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800937:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800943:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800950:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800957:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800963:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800969:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800975:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800981:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800988:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.800994:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801000:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801006:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801012:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801018:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801023:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801030:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801043:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801049:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801055:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801061:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801066:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801072:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801078:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801084:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801090:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801095:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801100:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061989.801106:0:15126:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789061989.803598:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9767c3f64800/c4c9b030-cc89-4fa3-a2aa-771221619f7d for MGS 00000020:00000080:2.0:1789061989.803680:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767c3f63000 for MGS 00000020:01000000:0.0:1789061989.803728:0:15126:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9766c6070d20 - data ffff9767ebf3f438/ffff9766c6748800 00000020:01000000:0.0:1789061989.804366:0:15126:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9767dec97de0 - data ffff9767ebc59e58/ffff9767ca4f1000 00000020:00000080:2.0:1789061989.808956:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6265 00000020:00000080:2.0:1789061989.808977:0:15126:0:(genops.c:885:class_export_put()) final put ffff976801c12800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789061989.809012:0:15126:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767c3163000 from MGS, refs=2 00000020:01000004:2.0:1789061989.809016:0:15126:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767c3163000 2 00000020:01000004:2.0:1789061989.809020:0:15126:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9767c3163000 from MGS 00000020:00000080:2.0:1789061989.809054:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789061989.809066:0:15126:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789061989.809069:0:15126:0:(genops.c:885:class_export_put()) final put ffff976801c17800/MGS 00000020:00000080:2.0:1789061989.809093:0:15126:0:(genops.c:844:class_export_destroy()) destroying export ffff976801c17800/MGS for MGS 00000020:01000000:2.0:1789061989.809102:0:15126:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789061989.809187:0:15126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789061989.809192:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789061989.809199:0:15126:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789061989.809207:0:15126:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9767c475e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789061989.809213:0:15126:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9767f7e93380) has exports, disconnecting them 00000020:00080000:2.0:1789061989.809219:0:15126:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9767c475e000), last request at 1789061753 00000020:00000080:2.0:1789061989.809224:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6330 00000020:00080000:2.0:1789061989.809242:0:15126:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9767c475e000): rc 0 00000020:00000080:2.0:1789061989.809246:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767c475e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789061989.809986:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff976801c12800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789061989.810006:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9767c475e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789061989.811207:0:15126:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789061989.811216:0:15126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789061989.811222:0:15126:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789061989.811232:0:15126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789061989.811479:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061989.811491:0:15126:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789061989.811492:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767f7eae800 for lustre-MDT0000-lwp-MDT0000 00000020:01000004:0.0:1789061989.811510:0:15126:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767c3163000 1 00000020:00000080:1.0:1789061989.811514:0:37:0:(genops.c:885:class_export_put()) final put ffff9767f7eaa000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789061989.811526:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9767f7eaa000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789061989.811534:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789061989.811537:0:15126:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6257 00000020:00000080:0.0:1789061989.811546:0:15126:0:(genops.c:885:class_export_put()) final put ffff976801c13000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789061989.811561:0:15126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789061989.811567:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061989.811572:0:15126:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789061989.811577:0:15126:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9767f3833380) has no exports 00000020:00000080:1.0:1789061989.811666:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff976801c13000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789061989.914141:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061989.914161:0:15126:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789061989.914168:0:15126:0:(genops.c:885:class_export_put()) final put ffff9767c3167800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789061989.914174:0:15126:0:(genops.c:844:class_export_destroy()) destroying export ffff9767c3167800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789061989.914182:0:15126:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789061989.914326:0:15126:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9767c3164800 00000020:02000400:0.0:1789061989.914404:0:15126:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789061990.186899:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061991.214830:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061992.105814:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061992.105836:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130891776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789061992.105918:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061992.106303:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130891776 00000100:00100000:3.0:1789061992.106322:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130891776 00000100:00100000:3.0:1789061992.106382:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789061992.106393:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130891776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789061992.106422:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789061992.106480:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130891776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789061992.106494:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1789061992.106580:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789061992.106660:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130891776:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789061992.233719:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061993.258487:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789061993.492757:0:15330:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789061993.511769:0:15330:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1789061993.511823:0:15330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.511838:0:15330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.511846:0:15330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.511863:0:15330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.511897:0:15330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789061993.511903:0:15330:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789061993.511931:0:15330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789061993.511935:0:15330:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789061993.511939:0:15330:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789061993.511945:0:15330:0:(import.c:65:import_set_state_nolock()) ffff9767fd130800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789061993.511950:0:15330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789061993.511951:0:15330:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789061993.511954:0:15330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789061993.512932:0:15330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.512944:0:15330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.512951:0:15330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.512957:0:15330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.512973:0:15330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789061993.512977:0:15330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.512984:0:15330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.513002:0:15330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.513009:0:15330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.513023:0:15330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789061993.513028:0:15330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.513035:0:15330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.513041:0:15330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.513048:0:15330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.513055:0:15330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789061993.513059:0:15330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483800/0x2774d8f311dc6384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.513065:0:15330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483800/0x2774d8f311dc6384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.513071:0:15330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483800/0x2774d8f311dc6384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.513086:0:15330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9767c1483800/0x2774d8f311dc6384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061993.513093:0:15330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1789061993.513095:0:15330:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1789061993.513117:0:15330:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1789061993.513120:0:15330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1789061993.513124:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789061993.513129:0:15330:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1789061993.513134:0:15330:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9766c744a000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789061993.513140:0:15330:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9766c56ea000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789061993.513145:0:15330:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9767f7e919c0) has exports, disconnecting them 00000020:00080000:1.0:1789061993.513150:0:15330:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9766c744a000), last request at 1789061988 00000020:00000080:1.0:1789061993.513156:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6663 00000100:00080000:1.0:1789061993.513173:0:15330:0:(import.c:65:import_set_state_nolock()) ffff9766c7449800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789061993.513211:0:15330:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9766c744a000): rc 0 00000020:00000080:1.0:1789061993.513214:0:15330:0:(genops.c:885:class_export_put()) final put ffff9766c744a000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1789061993.513222:0:15330:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9766c56ea000), last request at 1789061988 00000020:00000080:1.0:1789061993.513225:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc653d 00000100:00080000:1.0:1789061993.513229:0:15330:0:(import.c:65:import_set_state_nolock()) ffff9766c56ed800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1789061993.513236:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c744a000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1789061993.513272:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c7449800 for lustre-MDT0001 00000020:00080000:1.0:1789061993.513281:0:15330:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9766c56ea000): rc 0 00000020:00000080:1.0:1789061993.513283:0:15330:0:(genops.c:885:class_export_put()) final put ffff9766c56ea000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1789061993.513291:0:15330:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbc88417f3ae0 00000020:00000080:1.0:1789061993.513299:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c56ea000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789061993.513316:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9766c56ed800 for lustre-MDT0001 00000100:00080000:1.0:1789061993.513336:0:15330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789061993.513339:0:15330:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1789061993.514256:0:15330:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789061993.514262:0:15330:0:(import.c:65:import_set_state_nolock()) ffff9767f7e78000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1789061993.514689:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789061993.514700:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.514710:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ae00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061993.514713:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.514723:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061993.514746:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061993.514752:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789061993.514755:0:6483:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789061993.514758:0:6483:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789061993.514794:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.514801:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061993.514826:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.514834:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767fd47ae00/0x2774d8f311dc67b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc67ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.514845:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789061993.514858:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.514864:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47bc00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061993.514867:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.514880:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061993.514887:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061993.514903:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789061993.514905:0:6483:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1789061993.514907:0:6483:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1789061993.514920:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.514926:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061993.514932:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.514939:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767fd47bc00/0x2774d8f311dc67c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc67c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.514947:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789061993.514950:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.514956:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483c00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061993.514959:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.514966:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061993.514972:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061993.514977:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789061993.514979:0:6483:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789061993.514980:0:6483:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789061993.514994:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515000:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061993.515015:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515021:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1483c00/0x2774d8f311dc669b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc66a2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515032:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789061993.515036:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515041:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799e00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061993.515044:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515051:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061993.515057:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061993.515062:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789061993.515064:0:6483:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789061993.515066:0:6483:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789061993.515074:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515079:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061993.515083:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515094:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c3799e00/0x2774d8f311dc6a29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc6a30 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515103:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789061993.515106:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1483800/0x2774d8f311dc6384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515111:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483800 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789061993.515114:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483800/0x2774d8f311dc6384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515121:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1483800/0x2774d8f311dc6384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789061993.515127:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483800/0x2774d8f311dc6384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789061993.515132:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789061993.515134:0:6483:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789061993.515136:0:6483:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789061993.515144:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1483800/0x2774d8f311dc6384 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515149:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789061993.515153:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1483800/0x2774d8f311dc6384 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515159:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1483800/0x2774d8f311dc6384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2774d8f311dc638b expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789061993.515178:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061993.515180:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061993.515182:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789061993.515298:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130892160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061993.515358:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789061993.515409:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789061993.515414:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130892288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061993.515431:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789061993.515776:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061993.515788:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130892032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061993.515814:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061993.515854:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789061993.515859:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130891904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061993.515884:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061993.515897:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130892416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789061993.515912:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789061993.515930:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130892160 00000100:00100000:3.0:1789061993.515936:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130892160 00000100:00100000:3.0:1789061993.515959:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130892288 00000100:00100000:3.0:1789061993.515961:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130892288 00000100:00100000:3.0:1789061993.515967:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130892032 00000100:00100000:3.0:1789061993.515969:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130892032 00000100:00100000:3.0:1789061993.515976:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130891904 00000100:00100000:3.0:1789061993.515977:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130891904 00000100:00100000:3.0:1789061993.515983:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130892416 00000100:00100000:3.0:1789061993.515985:0:6481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130892416 00000100:00100000:3.0:1789061993.515994:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789061993.516000:0:6481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c629a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3620:x1875967130892160:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789061993.516006:0:6481:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789061993 with bad export cookie 2843135803265933953 00010000:00010000:0.0:1789061993.521728:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789061993.522407:0:15330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789061993.522412:0:15330:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1789061993.522431:0:15330:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789061993.522629:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789061993.522639:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3620:x1875967130892288:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789061993.522647:0:9499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789061993 with bad export cookie 2843135803265933953 00000100:00100000:2.0:1789061993.522733:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3620:x1875967130892288:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (7300us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789061993.522741:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789061993.522760:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789061993.522764:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1875967130892032:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789061993.522768:0:9499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789061993 with bad export cookie 2843135803265933953 00000100:00100000:2.0:1789061993.522800:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1875967130892032:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (6985us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789061993.522805:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789061993.522815:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789061993.522819:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1875967130891904:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789061993.522824:0:9499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789061993 with bad export cookie 2843135803265933953 00000100:00100000:2.0:1789061993.522842:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1875967130891904:12345-0@lo:103:ldlm_bl.0 Request processed in 21us (6957us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789061993.522858:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789061993.522868:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789061993.522872:0:9499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1875967130892416:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789061993.522876:0:9499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789061993 with bad export cookie 2843135803265933953 00000100:00100000:2.0:1789061993.522897:0:9499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3623:x1875967130892416:12345-0@lo:103:ldlm_bl.0 Request processed in 23us (6984us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789061993.522902:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789061993.522930:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789061993.522934:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9767c9fbc000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789061993.522937:0:3620:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1789061993.523041:0:15330:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789061993.523059:0:15330:0:(import.c:65:import_set_state_nolock()) ffff9767fb139000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789061993.523073:0:15330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789061993.523076:0:15330:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1789061993.523084:0:15330:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789061993.523148:0:15330:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789061993.523155:0:15330:0:(import.c:65:import_set_state_nolock()) ffff9767fb28c000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789061993.523177:0:15330:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9767f7e919c0) has no exports 00000100:00100000:0.0:1789061993.523694:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130892544:0@lo:9:umount.0 00000100:00100000:0.0:1789061993.523740:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061993.523767:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c842ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130892672:0@lo:9:umount.0 00000100:00100000:0.0:1789061993.523787:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789061993.523837:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1789061993.524762:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130892544 00000100:00100000:1.0:1789061993.524771:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130892544 00000100:00100000:1.0:1789061993.524813:0:8613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130892672 00000100:00100000:1.0:1789061993.524817:0:8613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130892672 00000100:00100000:1.0:1789061993.524850:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789061993.524858:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875967130892544:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789061993.524880:0:8613:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc658a 00000100:00080000:1.0:1789061993.524888:0:8613:0:(import.c:65:import_set_state_nolock()) ffff9767fb138000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789061993.524926:0:8613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789061993.525063:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3619:x1875967130892544:12345-0@lo:9:umount.0 Request processed in 206us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061993.525070:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789061993.525085:0:8613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789061993.525090:0:8613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875967130892672:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789061993.525113:0:8613:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc66da 00000100:00080000:1.0:1789061993.525119:0:8613:0:(import.c:65:import_set_state_nolock()) ffff9767fd65d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789061993.525139:0:8613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789061993.525208:0:8613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3619:x1875967130892672:12345-0@lo:9:umount.0 Request processed in 118us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789061993.525215:0:8613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789061993.525236:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789061993.525263:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fb139000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789061993.525274:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789061993.525276:0:3619:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789061993.525280:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130892544:0@lo:9:umount.0 00000100:00080000:1.0:1789061993.525292:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fb28c000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789061993.525298:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789061993.525299:0:3619:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789061993.525302:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c842ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130892672:0@lo:9:umount.0 00010000:00010000:3.0:1789061993.527823:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789061993.527890:0:6481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c629a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3620:x1875967130892160:12345-0@lo:103:ldlm_bl.0 Request processed in 11886us (12529us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789061993.527901:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1789061993.531946:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789061993.540187:0:3620:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.103@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789061993.540192:0:3620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789061993.540202:0:3620:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766c748ca80 x1875967130892160/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789062009 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061993.540216:0:3620:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766c748f800 x1875967130892288/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789062009 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061993.540225:0:3620:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766c748d500 x1875967130892032/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789062009 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061993.540235:0:3620:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766c748ed80 x1875967130891904/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789062009 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789061993.540243:0:3620:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766c748ce00 x1875967130892416/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789062009 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789061993.540251:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789061993.540254:0:3620:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789061993.540255:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789061993.540329:0:3623:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9767c9fbc000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789061993.540354:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130892416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789061993.540363:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130892032:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789061993.540366:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9767c9fbc000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789061993.540442:0:3620:0:(import.c:545:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 134 00000100:00080000:2.0:1789061993.540531:0:3620:0:(import.c:666:import_select_connection()) MGC192.168.203.103@tcp: import ffff9767c9fbc000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789061993.540591:0:3620:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c748ea00 x1875967130892800/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789061993.540593:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3623:1875967130891904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061993.540740:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130892160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789061993.540751:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3620:1875967130892288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789061993.540791:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3619:1875967130892800:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1789061993.540835:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875967130892800 offset 0 length 520: 4 00000020:00080000:2.0:1789061993.548817:0:15330:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9767f7e919c0) has no exports 00000020:01000000:3.0:1789061993.625520:0:15330:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9766c71587e0 - data ffff9766c58af0d8/ffff9767fd466400 00000020:01000000:3.0:1789061993.625723:0:15330:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9767fd285240 - data ffff9767ebd895e8/ffff9767fd297400 00000100:00080000:0.0:1789061993.641960:0:15132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789061993.641984:0:15132:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789061993.641988:0:15132:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789061993.641996:0:15132:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 369 00000100:00080000:0.0:1789061993.642002:0:15132:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789061993.642014:0:15132:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9767fd2c5000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1789061993.642050:0:15132:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c81a8a80 x1875967130892928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789061993.642102:0:15132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789061993.642106:0:15132:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789061993.642108:0:15132:0:(import.c:65:import_set_state_nolock()) ffff9767fb28a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789061993.642111:0:15132:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 369 00000100:00080000:0.0:1789061993.642114:0:15132:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789061993.642118:0:15132:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9767fb28a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1789061993.642128:0:15132:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c81a9f80 x1875967130893184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789061993.642167:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130893312:0@lo:400:kworker.0 00000100:00100000:0.0:1789061993.642236:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061993.642300:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130893312 00000100:00100000:0.0:1789061993.642306:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130893312 00000100:00100000:0.0:1789061993.642339:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789061993.642347:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1875967130893312:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789061993.642354:0:6498:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789061993.642386:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1875967130893312:12345-0@lo:400:kworker.0 Request processed in 39us (149us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789061993.642392:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1789061993.642434:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789061993.642438:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c3800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789061993.642442:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789061993.642935:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789061993.642947:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130893056:0@lo:400:kworker.0 00000100:00100000:2.0:1789061993.642980:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061993.643075:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875967130892928:0@lo:38:kworker.0 00000100:00100000:1.0:1789061993.643102:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061993.643121:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875967130893184:0@lo:38:kworker.0 00000100:00100000:1.0:1789061993.643137:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789061993.643160:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130893056 00000100:00100000:1.0:1789061993.643165:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130893056 00000100:00100000:1.0:1789061993.643185:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130892928 00000100:00100000:1.0:1789061993.643187:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130892928 00000100:00100000:1.0:1789061993.643196:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130893184 00000100:00100000:1.0:1789061993.643198:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130893184 00000100:00100000:1.0:1789061993.643207:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789061993.643212:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875967130893056:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789061993.643225:0:6497:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789061993.643252:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875967130893056:12345-0@lo:400:kworker.0 Request processed in 39us (271us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789061993.643258:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789061993.643271:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789061993.643274:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875967130892928:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789061993.643291:0:6497:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789061993.643313:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875967130892928:12345-0@lo:38:kworker.0 Request processed in 37us (210us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789061993.643318:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789061993.643327:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789061993.643331:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875967130893184:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789061993.643338:0:6497:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789061993.643357:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875967130893184:12345-0@lo:38:kworker.0 Request processed in 25us (218us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789061993.643362:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:1.0:1789061993.643387:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789061993.643391:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c3000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789061993.643394:0:3622:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789061993.643399:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789061993.643402:0:3622:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 170 00000100:00080000:1.0:1789061993.643408:0:3622:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9767fd2c3000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789061993.643438:0:3622:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c8172a00 x1875967130893440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789061993.643463:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130893056:0@lo:400:kworker.0 00000100:00100000:1.0:1789061993.643494:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875967130893440:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789061993.643516:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789061993.643534:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789061993.643538:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789061993.643541:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875967130892928:0@lo:38:kworker.0 00000100:00080000:1.0:1789061993.643547:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fb28a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789061993.643550:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789061993.643553:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875967130893184:0@lo:38:kworker.0 00000100:00100000:1.0:1789061993.643570:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130893440 00000100:00100000:1.0:1789061993.643573:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130893440 00000100:00100000:1.0:1789061993.643587:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789061993.643591:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875967130893440:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789061993.643599:0:6498:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1789061993.662804:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c3800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789061993.662813:0:3620:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 190 00000100:00080000:0.0:1789061993.662828:0:3620:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9767fd2c3800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1789061993.663063:0:3620:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c81a9180 x1875967130893568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789061993.663098:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130893312:0@lo:400:kworker.0 00000100:00100000:0.0:1789061993.663211:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875967130893568:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789061993.663270:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789061993.663328:0:10077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130893568 00000100:00100000:0.0:1789061993.663337:0:10077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130893568 00000100:00100000:0.0:1789061993.663368:0:10077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789061993.663375:0:10077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3619:x1875967130893568:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789061993.663391:0:10077:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789061993.663435:0:10077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3619:x1875967130893568:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 58us (163us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789061993.663443:0:10077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:0.0:1789061993.663500:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c3800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789061993.663505:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789061993.663508:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875967130893568:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789061993.683982:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875967130893440:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 40384us (40459us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789061993.683996:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:2.0:1789061993.684111:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789061993.684117:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789061993.684121:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875967130893440:0@lo:38:ptlrpcd_00_02.0 00000001:00000004:3.0:1789061993.684774:0:15330:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1789061993.729468:0:15330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789061993.729487:0:15330:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789061993.729495:0:15330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789061993.731553:0:15330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789061993.731560:0:15330:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1789061993.731579:0:15330:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789061993.731581:0:15330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789061993.732066:0:8607:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789061993.732070:0:8607:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789061993.732088:0:8607:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789061993.732647:0:15330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789061993.732652:0:15330:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1789061993.732665:0:15330:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789061993.732668:0:15330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789061993.733291:0:9799:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789061993.733295:0:9799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1789061993.733304:0:9799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789061993.734232:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc63a7 00000020:00000080:0.0:1789061993.734242:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767fb31f000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789061993.735447:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb31f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789061993.737406:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc63bc 00000020:00000080:0.0:1789061993.737420:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767fb31f800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789061993.737479:0:15330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1789061993.737485:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061993.737494:0:15330:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789061993.737499:0:15330:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9767f7e90000) has no exports 00000004:01000000:0.0:1789061993.737688:0:15330:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789061993.737912:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc66c5 00000020:00000080:0.0:1789061993.737918:0:15330:0:(genops.c:885:class_export_put()) final put ffff9766c754b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789061993.737957:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb31f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789061993.738394:0:15330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789061993.738399:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061993.738407:0:15330:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789061993.738410:0:15330:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff9766c71e3380) has no exports 00000020:00000080:0.0:1789061993.738416:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc66be 00000020:00000080:0.0:1789061993.738421:0:15330:0:(genops.c:885:class_export_put()) final put ffff9766c744b800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789061993.738681:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c754b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789061993.738926:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c744b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789061993.739267:0:15330:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789061993.739272:0:15330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789061993.739276:0:15330:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1789061993.739282:0:15330:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789061993.739284:0:15330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789061993.739361:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061993.739370:0:15330:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789061993.739381:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6583 00000020:00000080:0.0:1789061993.739397:0:15330:0:(genops.c:885:class_export_put()) final put ffff9766c1587000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789061993.739709:0:15132:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fb28c000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789061993.739786:0:15132:0:(genops.c:885:class_export_put()) final put ffff9766c744c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789061993.739789:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c744c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1789061993.739794:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789061993.739981:0:15330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789061993.739986:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061993.739992:0:15330:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789061993.739995:0:15330:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9767fb32b380) has no exports 00000020:00000080:0.0:1789061993.740002:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc657c 00000020:00000080:0.0:1789061993.740007:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767fb13f800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1789061993.740348:0:15330:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789061993.740352:0:15330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789061993.740355:0:15330:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:0.0:1789061993.740360:0:15330:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789061993.740362:0:15330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789061993.740388:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061993.740393:0:15330:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1789061993.740404:0:15330:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789061993.740410:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc63df 00000020:00000080:0.0:1789061993.740415:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767fd12f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789061993.740419:0:15330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1789061993.740422:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061993.740426:0:15330:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789061993.740428:0:15330:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9767f7e5b380) has no exports 00000020:00000080:0.0:1789061993.740432:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc63d8 00000020:00000080:0.0:1789061993.740434:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767c3f7a800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789061993.740817:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c1587000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789061993.740825:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb13f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789061993.740829:0:15132:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fb139000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789061993.740835:0:15132:0:(genops.c:885:class_export_put()) final put ffff9767ded20000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789061993.740836:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767ded20000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1789061993.740841:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789061993.745199:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd12f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789061993.745213:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767c3f7a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789061993.775945:0:15330:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789061993.775954:0:15330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789061993.775958:0:15330:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789061993.775966:0:15330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789061993.776055:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061993.776065:0:15330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789061993.776095:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061993.776098:0:15330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789061993.776104:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767fb31e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789061993.776117:0:15330:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb31e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789061993.776126:0:15330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789061993.776277:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc63c3 00000020:00000080:0.0:1789061993.776283:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767fb31b000/lustre-MDD0001_UUID 00000020:00000080:3.0:1789061993.776511:0:15132:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767f7e78000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789061993.776523:0:15132:0:(genops.c:885:class_export_put()) final put ffff9767c3f7b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789061993.776526:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767c3f7b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1789061993.776532:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789061993.776693:0:15330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789061993.776698:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061993.776702:0:15330:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789061993.776706:0:15330:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9767fb328000) has no exports 00000020:00000080:0.0:1789061993.776723:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061993.776726:0:15330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789061993.776730:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc63ca 00000020:00000080:0.0:1789061993.776734:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767fb31c800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789061993.776741:0:15330:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767fb057800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789061993.776744:0:15330:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fb057800 2 00000020:01000004:0.0:1789061993.776747:0:15330:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9767fb057800 from lustre-MDT0001 00000020:00000080:0.0:1789061993.776763:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061993.776765:0:15330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789061993.776767:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767fb318000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789061993.776769:0:15330:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb318000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789061993.776775:0:15330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789061993.776811:0:15330:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789061993.776814:0:15330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789061993.776816:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061993.776819:0:15330:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789061993.776824:0:15330:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9767fd132000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789061993.776830:0:15330:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9767f3830000) has exports, disconnecting them 00000020:00080000:0.0:1789061993.776834:0:15330:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9767fd132000), last request at 1789061771 00000020:00000080:0.0:1789061993.776837:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc641e 00000020:00080000:0.0:1789061993.776846:0:15330:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9767fd132000): rc 0 00000020:00000080:3.0:1789061993.776922:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb31b000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1789061993.776926:0:15132:0:(genops.c:885:class_export_put()) final put ffff9767fb31b800/lustre-MDD0001_UUID 00000020:00000080:3.0:1789061993.776928:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb31b800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1789061993.776931:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1789061993.777088:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb31c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789061993.777115:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767fd132000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789061993.777959:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd132000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789061993.805403:0:15330:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789061993.805412:0:15330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789061993.805417:0:15330:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789061993.805424:0:15330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789061993.805655:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789061993.805667:0:15330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789061993.805674:0:15330:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fb057800 1 00000020:00000080:1.0:1789061993.805682:0:15330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc635a 00000020:00000080:1.0:1789061993.805692:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767fb015800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789061993.805697:0:15330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789061993.805702:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789061993.805707:0:15330:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789061993.805710:0:15330:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9767f7e94d40) has no exports 00000020:00000080:3.0:1789061993.805946:0:15132:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fd130800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789061993.805954:0:15132:0:(genops.c:885:class_export_put()) final put ffff9767fd134800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1789061993.805958:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd134800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1789061993.805969:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1789061993.806036:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb015800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789061993.867012:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789061993.867027:0:15330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1789061993.867033:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767fb051000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789061993.867038:0:15330:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb051000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1789061993.867043:0:15330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1789061993.867154:0:15330:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9767fb055800 00000020:01000000:3.0:1789061993.867175:0:15330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789061993.867179:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789061993.867183:0:15330:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789061993.867186:0:15330:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9767fa378000) has no exports 00000100:00100000:0.0:1789061993.867536:0:6497:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9767c9833a00:6497] 1 exiting: rc = 0 00000100:00100000:0.0:1789061993.867680:0:10077:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9766c6496200:10077] 4 exiting: rc = 0 00000100:00100000:0.0:1789061993.867745:0:6498:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9767decc8400:6498] 2 exiting: rc = 0 00000100:00100000:2.0:1789061993.867967:0:6496:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9767dede1600:6496] 0 exiting: rc = 1 00000100:00100000:2.0:1789061993.868040:0:8435:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9766c61b5000:8435] 3 exiting: rc = 0 00000100:00100000:3.0:1789061993.868168:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868176:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868181:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868187:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868193:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868205:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868210:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868215:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868220:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868225:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868230:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868235:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868240:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868245:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868251:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868256:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868262:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868266:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868271:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868277:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868283:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868288:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868292:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868298:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868303:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868307:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868313:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868318:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868323:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868329:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868334:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868339:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868345:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868351:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868355:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868360:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868366:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868370:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868376:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868381:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868395:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868399:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868404:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868409:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868414:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868419:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868425:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868441:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868448:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868454:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868459:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868466:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868484:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868491:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868497:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868503:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868508:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868513:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868518:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868523:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868529:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868534:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868540:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.868546:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.871788:0:6499:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9767decc8200:6499] 0 exiting: rc = 1 00000100:00100000:0.0:1789061993.871972:0:6500:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9767f39d5c00:6500] 1 exiting: rc = 0 00000100:00100000:2.0:1789061993.872073:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872082:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872089:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872095:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872102:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872108:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872114:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872120:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872126:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872133:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872138:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872144:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872151:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872157:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872177:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872182:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872188:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872195:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872201:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872206:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872212:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872217:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872223:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872229:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872234:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872240:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872246:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872251:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872257:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872263:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872268:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872273:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872278:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872284:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872289:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872294:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872300:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872305:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872310:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872315:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872320:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872325:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872330:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872335:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872340:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872344:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872349:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872354:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872359:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872371:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872378:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872383:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872388:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872393:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872398:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872403:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872408:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872413:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872418:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872422:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872428:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872433:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872438:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872443:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.872971:0:6501:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9767dede0000:6501] 0 exiting: rc = 1 00000100:00100000:0.0:1789061993.873096:0:7866:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9767fd304a00:7866] 2 exiting: rc = 0 00000100:00100000:2.0:1789061993.873674:0:6502:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9767f395f800:6502] 1 exiting: rc = 0 00000100:00100000:0.0:1789061993.873789:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873807:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873815:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873820:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873826:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873831:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873837:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873842:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873856:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873863:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873879:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873887:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873892:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873898:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873905:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873909:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873914:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873919:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873924:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873929:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873935:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873940:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873957:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873963:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873969:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873974:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873979:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873985:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.873990:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874003:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874009:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874014:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874020:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874025:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874042:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874051:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874058:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874063:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874069:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874074:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874079:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874084:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874089:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874095:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874100:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874105:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874124:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874130:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874135:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874141:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874147:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874152:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874158:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874163:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874168:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874173:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874179:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874184:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874202:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874214:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874220:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874225:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874231:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789061993.874237:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.887222:0:6503:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9767f39d4e00:6503] 0 exiting: rc = 1 00000100:00100000:1.0:1789061993.888003:0:6504:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9767f39d5800:6504] 1 exiting: rc = 0 00000100:00100000:3.0:1789061993.888109:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888116:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888121:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888125:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888131:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888135:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888140:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888144:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888149:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888153:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888169:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888174:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888178:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888182:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888187:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888191:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888195:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888200:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888205:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888210:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888215:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888220:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888224:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888229:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888233:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888237:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888242:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888247:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888252:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888257:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888261:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888266:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888270:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888275:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888280:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888284:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888289:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888293:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888297:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888302:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888306:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888311:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888315:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888320:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888324:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888337:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888342:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888347:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888352:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888357:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888362:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888367:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888371:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888375:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888380:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888386:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888391:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888396:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888400:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888405:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888410:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888415:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888419:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.888424:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789061993.889051:0:6505:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9767f39d4400:6505] 0 exiting: rc = 1 00000100:00100000:1.0:1789061993.889178:0:6506:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9767f39d4600:6506] 1 exiting: rc = 0 00000100:00100000:3.0:1789061993.889332:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889339:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889344:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889350:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889356:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889361:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889366:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889372:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889377:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889382:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889388:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889393:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889398:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889404:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889410:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889415:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889431:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889436:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889442:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889447:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889453:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889458:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889463:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889469:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889487:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889493:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889498:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889504:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889509:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889514:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889519:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889524:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889528:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889533:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889538:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889542:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889548:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889553:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889559:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889565:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889571:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889577:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889582:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889587:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889592:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889597:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889602:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889957:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889962:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889967:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889972:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889986:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889991:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.889997:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.890002:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.890008:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.890013:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.890018:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.890024:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.890029:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.890035:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.890040:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.890047:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.890052:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789061993.894124:0:6507:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9767fa3f2800:6507] 0 exiting: rc = 1 00000100:00100000:2.0:1789061993.894398:0:6508:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9767fa3f2a00:6508] 1 exiting: rc = 0 00000100:00100000:3.0:1789061993.894553:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894561:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894567:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894571:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894576:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894582:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894587:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894593:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894597:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894602:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894634:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894639:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894645:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894651:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894656:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894661:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894666:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894671:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894675:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894680:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894684:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894689:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894706:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894712:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894716:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894721:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894725:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894729:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894734:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894739:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894744:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894749:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894754:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894758:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894763:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894768:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894773:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894778:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894783:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894788:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894793:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894797:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894801:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894807:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894812:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894818:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894823:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894829:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894834:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894840:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894845:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894863:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894869:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894873:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894879:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894884:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894889:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894903:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894907:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894912:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894918:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894923:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894928:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.894934:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.895492:0:6510:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff976801c6c600:6510] 1 exiting: rc = 0 00000100:00100000:3.0:1789061993.895676:0:6511:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9767f395ee00:6511] 2 exiting: rc = 0 00000100:00100000:1.0:1789061993.896011:0:6509:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff976801c6c400:6509] 0 exiting: rc = 1 00000100:00100000:3.0:1789061993.896209:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896220:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896226:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896245:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896253:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896259:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896265:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896271:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896278:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896284:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896290:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896296:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896301:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896308:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896314:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896319:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896325:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896330:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896336:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896342:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896347:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896352:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896358:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896363:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896368:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896374:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896391:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896410:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896417:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896422:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896428:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896433:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896438:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896443:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896448:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896454:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896459:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896464:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896469:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896486:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896491:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896496:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896502:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896506:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896511:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896517:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896522:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896528:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896533:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896537:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896542:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896561:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896569:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896575:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896580:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896586:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896591:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896596:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896601:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896635:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896641:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896654:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896660:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789061993.896671:0:15330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789061993.904040:0:15330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789061993.904054:0:15330:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789061993.904059:0:15330:0:(genops.c:885:class_export_put()) final put ffff9767df9c6800/MDS_uuid 00000020:00000080:3.0:1789061993.904064:0:15330:0:(genops.c:844:class_export_destroy()) destroying export ffff9767df9c6800/MDS_uuid for MDS 00000020:01000000:3.0:1789061993.904070:0:15330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789061993.904210:0:15330:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1789061994.281937:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061995.306924:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061996.330689:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789061997.359846:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789061997.506161:0:15531:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789061997.526459:0:15531:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789061997.526512:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061997.526528:0:15531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061997.526535:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061997.526542:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061997.526566:0:15531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789061997.526571:0:15531:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789061997.526594:0:15531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789061997.526599:0:15531:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789061997.526642:0:15531:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789061997.526649:0:15531:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c5000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789061997.526654:0:15531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789061997.526655:0:15531:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789061997.526659:0:15531:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789061997.527209:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789061997.527217:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061997.527225:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c74dbe00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789061997.527229:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061997.527239:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789061997.527246:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789061997.527251:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789061997.527254:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789061997.527257:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789061997.527271:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9767c9fbc000 00010000:00010000:3.0:1789061997.527275:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061997.527282:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c74dbe00/0x2774d8f311dc6797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc679e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789061997.527311:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061997.527312:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061997.527314:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789061997.528480:0:15531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789061997.528487:0:15531:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789061997.528496:0:15531:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789061997.528502:0:15531:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c3000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789061997.528508:0:15531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789061997.528518:0:15531:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789061997.528521:0:15531:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789061997.530910:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061997.530928:0:15531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061997.530935:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061997.530942:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061997.530972:0:15531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789061997.530979:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061997.530985:0:15531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061997.530991:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061997.530996:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789061997.531014:0:15531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789061997.531018:0:15531:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789061997.531039:0:15531:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789061997.531043:0:15531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789061997.531059:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061997.531064:0:15531:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789061997.531071:0:15531:0:(genops.c:1818:print_export_data()) lustre-OST0000: UNLINKED ffff9767fb139800 lustre-MDT0001-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:0.0:1789061997.531077:0:15531:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9767f38ab380) has no exports 00000020:00080000:0.0:1789061997.531108:0:15531:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9767f38ab380) has no exports 00010000:00010000:1.0:1789061997.532525:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789061997.532537:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061997.532547:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c74da800 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789061997.532551:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061997.532561:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061997.532568:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061997.532573:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789061997.532576:0:6483:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789061997.532579:0:6483:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789061997.532625:0:6483:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9767c9fbc000 00010000:00010000:1.0:1789061997.532629:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061997.532636:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c74da800/0x2774d8f311dc67a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc67ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061997.532652:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789061997.532656:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061997.532662:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031800 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789061997.532665:0:6483:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061997.532671:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789061997.532676:0:6483:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789061997.532681:0:6483:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789061997.532683:0:6483:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789061997.532685:0:6483:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789061997.532689:0:6483:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9767c9fbc000 00010000:00010000:1.0:1789061997.532692:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061997.532697:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c0031800/0x2774d8f311dc6a1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc6a22 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789061997.532716:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061997.532717:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789061997.532719:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789061997.532782:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789061998.377893:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789061998.761962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c4c9b030-cc89-4fa3-a2aa-771221619f7d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789061998.761972:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c4c9b030-cc89-4fa3-a2aa-771221619f7d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789061998.761975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789061998.761979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789061998.761982:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767fb28a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789061998.761990:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 374 00000100:00080000:3.0:1789061998.761996:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789061998.762007:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9767fb28a800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1789061998.762154:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c83e1500 x1875967130893696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789061998.762208:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875967130893696:0@lo:38:kworker.0 00000400:00000100:1.0:1789061998.762259:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875967130893696 offset 0 length 520: 4 00000100:00080000:3.0:1789061998.762353:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789061998.762358:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789061998.762360:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c3800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789061998.762364:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 374 00000100:00080000:3.0:1789061998.762367:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789061998.762372:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9767fd2c3800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1789061998.762386:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c83e1c00 x1875967130893824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000001:00100000:0.0:1789061998.763897:0:8406:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789061998.763904:0:8406:0:(genops.c:885:class_export_put()) final put ffff9767fb139800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789061998.766887:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb139800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789061998.766945:0:15132:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fb138000 for lustre-OST0000 00000001:00100000:0.0:1789061998.768696:0:9490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789061998.768704:0:9490:0:(genops.c:885:class_export_put()) final put ffff9766c1584800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789061998.768782:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c1584800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789061998.768838:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fd65d800 for lustre-OST0001 00000100:00100000:1.0:1789061998.769063:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875967130893824:0@lo:38:kworker.0 00000400:00000100:1.0:1789061998.769115:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875967130893824 offset 0 length 520: 4 00010000:00010000:1.0:1789061999.401759:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789061999.593928:0:15531:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9766c74813c0 - data ffff9767ebe8e0d8/ffff9767fb100000 00000020:01000000:3.0:1789061999.594071:0:15531:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9767fb155780 - data ffff9767ebdedaf8/ffff9767fd6aec00 00100000:10000000:3.0:1789061999.603485:0:15531:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789061999.612073:0:15531:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc64f7 00000020:00000080:2.0:1789061999.612084:0:15531:0:(genops.c:885:class_export_put()) final put ffff9766c572c000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789061999.612147:0:15531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767fd12c000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789061999.612151:0:15531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fd12c000 2 00000020:01000004:2.0:1789061999.612154:0:15531:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9767fd12c000 from lustre-OST0000 00000020:00000080:2.0:1789061999.612176:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789061999.612185:0:15531:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789061999.612188:0:15531:0:(genops.c:885:class_export_put()) final put ffff9767f4533000/lustre-OST0000_UUID 00000020:00000080:2.0:1789061999.612191:0:15531:0:(genops.c:844:class_export_destroy()) destroying export ffff9767f4533000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789061999.612205:0:15531:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789061999.612251:0:15531:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789061999.612255:0:15531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789061999.612259:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789061999.612264:0:15531:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789061999.612270:0:15531:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9767fd2c7000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789061999.612276:0:15531:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9767f38acd40) has exports, disconnecting them 00000020:00080000:2.0:1789061999.612281:0:15531:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9767fd2c7000), last request at 1789061789 00000020:00000080:2.0:1789061999.612285:0:15531:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6521 00000020:00080000:2.0:1789061999.612294:0:15531:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9767fd2c7000): rc 0 00000020:00000080:2.0:1789061999.612299:0:15531:0:(genops.c:885:class_export_put()) final put ffff9767fd2c7000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789061999.612372:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c572c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789061999.617391:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd2c7000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789061999.618235:0:15531:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789061999.618242:0:15531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789061999.618247:0:15531:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789061999.618253:0:15531:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789061999.618424:0:15132:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fd2c5000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789061999.620108:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789061999.620120:0:15531:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789061999.620126:0:15531:0:(genops.c:885:class_export_put()) final put ffff9766c572a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789061999.620130:0:15531:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c572a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789061999.620143:0:15531:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789061999.620230:0:15531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789061999.620244:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789061999.620248:0:15531:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789061999.620255:0:15531:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9767fb015000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789061999.620263:0:15531:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff9767fb3299c0) has exports, disconnecting them 00000020:00080000:1.0:1789061999.620269:0:15531:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9767fb015000), last request at 1789061789 00000020:00000080:1.0:1789061999.620273:0:15531:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6536 00000020:00080000:1.0:1789061999.620288:0:15531:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9767fb015000): rc 0 00000020:00000080:1.0:1789061999.620292:0:15531:0:(genops.c:885:class_export_put()) final put ffff9767fb015000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789061999.620527:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb015000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789061999.624677:0:15531:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789061999.624685:0:15531:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789061999.624699:0:15531:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789061999.624707:0:15531:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789061999.624739:0:15132:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fd2c3000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789061999.624933:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061999.624941:0:15531:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789061999.624946:0:15531:0:(genops.c:885:class_export_put()) final put ffff9767fd2c0800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789061999.624949:0:15531:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd2c0800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789061999.624957:0:15531:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789061999.625017:0:15531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fd12c000 1 00000020:00000080:0.0:1789061999.625023:0:15531:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc64bf 00000020:00000080:0.0:1789061999.625038:0:15531:0:(genops.c:885:class_export_put()) final put ffff9767fd30a800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789061999.625047:0:15531:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789061999.625054:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd30a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789061999.625063:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789061999.625068:0:15531:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789061999.625072:0:15531:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9767f38319c0) has no exports 00000020:00000080:0.0:1789061999.773043:0:15531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789061999.773057:0:15531:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789061999.773063:0:15531:0:(genops.c:885:class_export_put()) final put ffff9767fd137800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789061999.773067:0:15531:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd137800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789061999.773077:0:15531:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789061999.773209:0:15531:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9767fd12c800 00000020:02000400:0.0:1789061999.773414:0:15531:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789062000.425942:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062001.453924:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062002.474714:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789062002.995846:0:15731:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789062003.006727:0:15731:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789062003.006807:0:15731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062003.006823:0:15731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062003.006830:0:15731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062003.006838:0:15731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062003.006857:0:15731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789062003.006863:0:15731:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789062003.006885:0:15731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789062003.006897:0:15731:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766c83e1500 x1875967130893696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789062018 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062003.006924:0:15731:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789062003.006930:0:15731:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789062003.006936:0:15731:0:(import.c:65:import_set_state_nolock()) ffff9767fb28a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789062003.006941:0:15731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789062003.006945:0:15731:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766c83e1500 x1875967130893696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789062018 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062003.006952:0:15731:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789062003.006955:0:15731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789062003.007714:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789062003.007722:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062003.007731:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c3799800 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789062003.007735:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062003.007744:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789062003.007752:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062003.007757:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789062003.007760:0:7904:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789062003.007763:0:7904:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789062003.007774:0:7904:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9767c9fbc000 00010000:00010000:2.0:1789062003.007787:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062003.007794:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c3799800/0x2774d8f311dc677b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc6782 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062003.007805:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062003.007806:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062003.007808:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789062003.007835:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875967130893696:0@lo:38:kworker.0 00000100:00080000:0.0:1789062003.008779:0:15731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789062003.008788:0:15731:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766c83e1c00 x1875967130893824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789062013 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062003.008805:0:15731:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789062003.008811:0:15731:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789062003.008815:0:15731:0:(import.c:65:import_set_state_nolock()) ffff9767fd2c3800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789062003.008820:0:15731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789062003.008823:0:15731:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766c83e1c00 x1875967130893824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789062013 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062003.008830:0:15731:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789062003.008833:0:15731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:2.0:1789062003.009138:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875967130893824:0@lo:38:kworker.0 00010000:00010000:0.0:1789062003.010310:0:15731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062003.010326:0:15731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062003.010335:0:15731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062003.010359:0:15731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062003.010386:0:15731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789062003.010393:0:15731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062003.010400:0:15731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062003.010415:0:15731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062003.010422:0:15731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062003.010438:0:15731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789062003.010442:0:15731:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789062003.010465:0:15731:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789062003.010469:0:15731:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789062003.010473:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789062003.010478:0:15731:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789062003.010482:0:15731:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9767fb32cd40) has no exports 00000020:00080000:0.0:1789062003.010503:0:15731:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff9767fb32cd40) has no exports 00010000:00010000:3.0:1789062003.010916:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789062003.010923:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062003.010931:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c74dac00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789062003.010935:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062003.010944:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789062003.010951:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789062003.010957:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789062003.010960:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789062003.010962:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789062003.010974:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9767c9fbc000 00010000:00010000:3.0:1789062003.010977:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062003.010984:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c74dac00/0x2774d8f311dc6789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc6790 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062003.010996:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789062003.010999:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062003.011004:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030400 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789062003.011013:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062003.011020:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789062003.011026:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789062003.011031:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789062003.011033:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789062003.011035:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789062003.011039:0:6484:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9767c9fbc000 00010000:00010000:3.0:1789062003.011041:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062003.011047:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc6a0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc6a14 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062003.011059:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062003.011060:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062003.011062:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062003.011105:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789062003.013043:0:15731:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9766c73ff720 - data ffff9767ebf2d438/ffff9766c72f4800 00000020:01000000:0.0:1789062003.013191:0:15731:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9766c6070240 - data ffff9767ebf3c798/ffff9767fd6fa800 00100000:10000000:0.0:1789062003.033215:0:15731:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789062003.040633:0:15731:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc661d 00000020:00000080:1.0:1789062003.040646:0:15731:0:(genops.c:885:class_export_put()) final put ffff9767ffd54800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1789062003.040662:0:15731:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767fd65c800 from lustre-OST0001, refs=2 00000020:00000080:2.0:1789062003.040687:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767ffd54800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:1.0:1789062003.040886:0:15731:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fd65c800 2 00000020:01000004:1.0:1789062003.040892:0:15731:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9767fd65c800 from lustre-OST0001 00000020:00000080:1.0:1789062003.040915:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789062003.040924:0:15731:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789062003.040928:0:15731:0:(genops.c:885:class_export_put()) final put ffff9767ffd50000/lustre-OST0001_UUID 00000020:00000080:1.0:1789062003.040930:0:15731:0:(genops.c:844:class_export_destroy()) destroying export ffff9767ffd50000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789062003.040937:0:15731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789062003.041052:0:15731:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c4c9b030-cc89-4fa3-a2aa-771221619f7d->MGS 00010000:00010000:1.0:1789062003.041068:0:15731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1483a00/0x2774d8f311dc6376 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc637d expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789062003.041080:0:15731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483a00/0x2774d8f311dc6376 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc637d expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789062003.041086:0:15731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789062003.041089:0:15731:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789062003.041092:0:15731:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789062003.041104:0:15731:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9767c9fbc000 00010000:00010000:1.0:1789062003.041109:0:15731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1483a00/0x2774d8f311dc6376 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc637d expref: -99 pid: 7425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062003.041125:0:15731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c74db800/0x2774d8f311dc67eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2774d8f311dc67f2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789062003.041132:0:15731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c74db800/0x2774d8f311dc67eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2774d8f311dc67f2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789062003.041137:0:15731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789062003.041139:0:15731:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789062003.041150:0:15731:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789062003.041160:0:15731:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9767c9fbc000 00010000:00010000:1.0:1789062003.041162:0:15731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c74db800/0x2774d8f311dc67eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2774d8f311dc67f2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789062003.041190:0:15731:0:(import.c:65:import_set_state_nolock()) ffff9767c9fbc000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789062003.041194:0:15731:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789062003.041196:0:15731:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789062003.041197:0:15731:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789062003.041202:0:15731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789062003.041212:0:15731:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766c748ea00 x1875967130892800/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789062003 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789062003.041230:0:15731:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789062003.041232:0:15731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1789062003.041298:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c4c9b030-cc89-4fa3-a2aa-771221619f7d:3619:1875967130892800:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:1.0:1789062003.041395:0:15731:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789062003.041402:0:15731:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6273 00000020:00000080:1.0:1789062003.041415:0:15731:0:(genops.c:885:class_export_put()) final put ffff9767df9c4000/c4c9b030-cc89-4fa3-a2aa-771221619f7d 00000020:01000000:1.0:1789062003.041430:0:15731:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.103@tcp (flags='') 00000020:00000080:1.0:1789062003.041435:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789062003.041439:0:15731:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789062003.041443:0:15731:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9767f38a8000) has no exports 00000020:00000080:2.0:1789062003.041652:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767df9c4000/c4c9b030-cc89-4fa3-a2aa-771221619f7d for MGC192.168.203.103@tcp 10000000:01000000:3.0:1789062003.041841:0:6493:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789062003.041961:0:15731:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.103@tcp: client import never connected 00000100:00080000:1.0:1789062003.041965:0:15731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789062003.041967:0:15731:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789062003.041969:0:15731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789062003.041971:0:15731:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789062003.042013:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789062003.042018:0:15731:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.103@tcp (uuid c4c9b030-cc89-4fa3-a2aa-771221619f7d) 00000020:01000000:1.0:1789062003.042024:0:15731:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789062003.042027:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789062003.042031:0:15731:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789062003.042035:0:15731:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9767fd30a000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789062003.042051:0:15731:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff9766c71e0000) has exports, disconnecting them 00000020:00080000:1.0:1789062003.042055:0:15731:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9767fd30a000), last request at 1789061809 00000020:00000080:1.0:1789062003.042060:0:15731:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc6647 00000020:00080000:1.0:1789062003.042071:0:15731:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9767fd30a000): rc 0 00000020:00000080:1.0:1789062003.042074:0:15731:0:(genops.c:885:class_export_put()) final put ffff9767fd30a000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789062003.042269:0:15132:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767c9fbc000 for MGC192.168.203.103@tcp 00000020:00000080:2.0:1789062003.042277:0:15132:0:(genops.c:885:class_export_put()) final put ffff9767c9fba000/c4c9b030-cc89-4fa3-a2aa-771221619f7d 00000020:00000080:2.0:1789062003.042279:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767c9fba000/c4c9b030-cc89-4fa3-a2aa-771221619f7d for MGC192.168.203.103@tcp 00000020:01000000:2.0:1789062003.042283:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.103@tcp (c4c9b030-cc89-4fa3-a2aa-771221619f7d) 00000020:00000080:2.0:1789062003.042522:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd30a000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789062003.047674:0:15731:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789062003.047683:0:15731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789062003.047688:0:15731:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789062003.047696:0:15731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789062003.047868:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789062003.047877:0:15731:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1789062003.047883:0:15731:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789062003.047887:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789062003.047902:0:15731:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789062003.047909:0:15731:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9766c7448800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789062003.047915:0:15731:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff9766c71e19c0) has exports, disconnecting them 00000020:00080000:2.0:1789062003.047920:0:15731:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9766c7448800), last request at 1789061809 00000020:00000080:2.0:1789062003.047939:0:15731:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc665c 00000020:00080000:2.0:1789062003.047956:0:15731:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9766c7448800): rc 0 00000020:00000080:2.0:1789062003.047962:0:15731:0:(genops.c:885:class_export_put()) final put ffff9766c7448800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789062003.048521:0:15132:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fb28a800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789062003.048530:0:15132:0:(genops.c:885:class_export_put()) final put ffff9767fb28f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789062003.048533:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb28f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789062003.048544:0:15132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789062003.048627:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9766c7448800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1789062003.050679:0:15731:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789062003.050686:0:15731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789062003.050700:0:15731:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789062003.050707:0:15731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789062003.050737:0:15132:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9767fd2c3800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789062003.062768:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789062003.063196:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789062003.063485:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789062003.063778:0:6478:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9767c3827200:6478] 0 exiting: rc = 1 00000100:00100000:3.0:1789062003.064003:0:6479:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9767f395d000:6479] 1 exiting: rc = 0 00000100:00100000:1.0:1789062003.064191:0:7437:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9767fb15fe00:7437] 2 exiting: rc = 0 00000100:00100000:3.0:1789062003.064419:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.064767:0:6481:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9767f395c800:6481] 1 exiting: rc = 0 00000100:00100000:3.0:1789062003.064900:0:9499:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9767f7e8e200:9499] 3 exiting: rc = 0 00000100:00100000:2.0:1789062003.064998:0:6480:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9767f395d800:6480] 0 exiting: rc = 1 00000100:00100000:0.0:1789062003.065163:0:6482:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9767c28aea00:6482] 2 exiting: rc = 0 00000100:00100000:3.0:1789062003.065498:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065506:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065514:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065521:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065544:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065551:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065557:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065564:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065570:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065575:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065581:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065586:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065591:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065596:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065602:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065640:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065645:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065651:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065657:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065663:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065868:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065876:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065882:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065887:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065892:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065897:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065903:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065919:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065924:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065930:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065936:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065941:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065947:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065952:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065958:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065963:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065968:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065973:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065978:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065983:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065988:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065993:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.065998:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066003:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066008:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066013:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066018:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066024:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066030:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066036:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066041:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066047:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066052:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066057:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066063:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066068:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066074:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066079:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066085:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066091:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066096:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066101:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066115:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.066120:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789062003.075759:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789062003.075774:0:15731:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1789062003.075780:0:15731:0:(genops.c:885:class_export_put()) final put ffff9767fb289000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1789062003.075850:0:15731:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb289000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789062003.075864:0:15731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1789062003.075929:0:15731:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fd65c800 1 00000020:00000080:3.0:1789062003.075934:0:15731:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2774d8f311dc65ec 00000020:00000080:3.0:1789062003.075940:0:15731:0:(genops.c:885:class_export_put()) final put ffff9767fb288800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789062003.075958:0:15731:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789062003.075962:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789062003.075967:0:15731:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789062003.075971:0:15731:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff9766c645b380) has no exports 00000020:00000080:1.0:1789062003.076366:0:15132:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fb288800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789062003.124192:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789062003.124207:0:15731:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789062003.124213:0:15731:0:(genops.c:885:class_export_put()) final put ffff9767fd65e000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789062003.124218:0:15731:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd65e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789062003.124225:0:15731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789062003.125269:0:15731:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9767fd659000 00000020:01000000:3.0:1789062003.125295:0:15731:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789062003.125301:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789062003.125306:0:15731:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789062003.125310:0:15731:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9767f38a99c0) has no exports 00000020:00000080:3.0:1789062003.125331:0:15731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789062003.125337:0:15731:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789062003.125340:0:15731:0:(genops.c:885:class_export_put()) final put ffff9767fd308800/OSS_uuid 00000020:00000080:3.0:1789062003.125343:0:15731:0:(genops.c:844:class_export_destroy()) destroying export ffff9767fd308800/OSS_uuid for OSS 00000020:01000000:3.0:1789062003.125348:0:15731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789062003.125448:0:8411:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9767fd223600:8411] 0 exiting: rc = 1 00000100:00100000:3.0:1789062003.125532:0:8613:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9766c61b1c00:8613] 3 exiting: rc = 0 00000100:00080000:1.0:1789062003.125700:0:6492:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789062003.125809:0:8413:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9767c7c97e00:8413] 2 exiting: rc = 0 00000100:00100000:1.0:1789062003.125809:0:8412:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9767fd223000:8412] 1 exiting: rc = 0 00000100:00100000:3.0:1789062003.125950:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.125968:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.125975:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.125985:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.125991:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.125996:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126001:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126006:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126011:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126016:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126021:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126026:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126031:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126036:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126041:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126046:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126051:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126057:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126062:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126067:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126072:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126078:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126083:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126088:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126093:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126098:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126103:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126108:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126114:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126119:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126124:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126130:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126136:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126142:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126147:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126153:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126166:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126172:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126177:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126183:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126188:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126194:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126199:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126205:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126211:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126216:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126221:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126226:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126231:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126236:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126242:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126247:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126253:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126271:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126276:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126281:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126292:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126298:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126303:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126307:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126312:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126317:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126321:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.126326:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.127317:0:8415:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9767fb060800:8415] 1 exiting: rc = 0 00000100:00100000:1.0:1789062003.127670:0:11983:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9767fd4a7e00:11983] 2 exiting: rc = 0 00000100:00100000:1.0:1789062003.127746:0:8414:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9767dfe00800:8414] 0 exiting: rc = 1 00000100:00100000:3.0:1789062003.128001:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128010:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128017:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128022:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128027:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128033:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128039:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128057:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128063:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128068:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128074:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128079:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128084:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128090:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128095:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128101:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128105:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128110:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128116:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128121:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128126:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128132:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128137:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128142:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128147:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128152:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128157:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128162:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128166:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128171:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128176:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128181:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128185:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128190:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128194:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128199:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128205:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128211:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128216:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128222:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128228:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128234:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128247:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128253:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128415:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128424:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128429:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128440:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128446:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128452:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128457:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128463:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128468:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128473:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128489:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128496:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128501:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128506:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128511:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128517:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128522:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128527:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128533:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.128544:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789062003.133354:0:8416:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9767fd22c200:8416] 0 exiting: rc = 1 00000100:00100000:0.0:1789062003.133378:0:8418:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9767fd22ce00:8418] 2 exiting: rc = 0 00000100:00100000:3.0:1789062003.133954:0:8417:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9767fd22c600:8417] 1 exiting: rc = 0 00000100:00100000:2.0:1789062003.134233:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134242:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134247:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134253:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134324:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134331:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134337:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134341:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134347:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134353:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134362:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134367:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134373:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134378:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134384:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134390:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134396:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134402:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134437:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134452:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134461:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134467:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134472:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134478:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134483:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134488:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134494:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134499:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134505:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134509:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134515:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134520:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134526:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134532:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134537:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134543:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134548:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134553:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134559:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134564:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134570:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134576:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.134597:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.136992:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137009:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137015:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137020:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137025:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137030:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137035:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137041:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137046:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137051:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137057:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137082:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137087:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137097:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137104:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137123:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137130:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137136:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137142:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137148:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789062003.137154:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.145114:0:8419:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9767fd22d200:8419] 0 exiting: rc = 1 00000100:00100000:0.0:1789062003.145213:0:8420:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9767fb03e800:8420] 1 exiting: rc = 0 00000100:00100000:3.0:1789062003.145361:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145368:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145374:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145379:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145384:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145389:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145394:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145399:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145405:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145424:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145432:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145437:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145524:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145530:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145536:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145541:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145546:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145551:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145631:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145639:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145643:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145649:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145654:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145658:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145777:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145847:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145853:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145859:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145864:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145869:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145874:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145879:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145884:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145888:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145894:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145899:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145909:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145919:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145925:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145930:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145935:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145940:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145945:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145951:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145956:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145961:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145965:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145978:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145983:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145987:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145992:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.145996:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.146001:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.146006:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.146011:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.146015:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.146021:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.146026:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.146031:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.146036:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.146041:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.146047:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.146058:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.146065:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789062003.147387:0:8421:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9767fb03ee00:8421] 0 exiting: rc = 1 00000100:00100000:0.0:1789062003.147736:0:8422:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9767c9ae5000:8422] 1 exiting: rc = 0 00000100:00100000:0.0:1789062003.148145:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148161:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148337:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148346:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148352:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148357:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148364:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148371:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148377:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148383:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148389:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148395:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148401:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148418:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148439:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148446:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148519:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148528:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148534:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148540:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148546:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148554:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148759:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148767:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148773:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148781:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148871:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148880:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148886:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148891:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148897:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148915:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148921:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148927:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148933:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148938:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148944:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148949:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148968:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148975:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148980:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148986:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148993:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.148998:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149004:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149010:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149015:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149024:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149030:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149035:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149056:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149062:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149068:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149074:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149080:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149085:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149091:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149097:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149105:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149110:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149117:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149123:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149130:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789062003.149143:0:15731:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789062003.159077:0:15731:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789062021.691859:0:16495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789062032.241176:0:17094:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789062032.241184:0:17094:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789062032.241186:0:17094:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789062032.241332:0:17094:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9767f7e7a800 00000020:01000004:2.0:1789062032.241353:0:17094:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789062032.241363:0:17094:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789062032.241383:0:17094:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9767fb32cd40) 00000020:00000080:2.0:1789062032.241402:0:17094:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789062032.321092:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.328488:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789062032.332601:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1789062032.335450:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.336462:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.338140:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.338476:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.338974:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.339230:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.339456:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.339676:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.340115:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.340349:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.340575:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.341895:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.344112:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.345288:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.346963:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.348639:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.349946:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.352983:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.354243:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.354936:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.355165:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.355530:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.356106:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.356887:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.358075:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.359178:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789062032.360287:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1789062032.362160:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789062032.363484:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789062032.365196:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789062032.365522:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789062032.366065:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789062032.366534:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789062032.367037:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789062032.367564:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789062032.369815:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789062032.370382:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789062032.371755:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789062032.372296:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789062032.372573:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789062032.373908:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789062032.374573:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789062032.383662:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789062032.385408:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789062032.390816:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1789062032.391191:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1789062032.391456:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1789062032.392565:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1789062032.393315:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1789062032.393537:0:17094:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1789062032.394570:0:17094:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789062032.395102:0:17094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789062032.395112:0:17094:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789062032.395126:0:17094:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc7822 00000020:01000004:3.0:1789062032.395135:0:17094:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789062032.395141:0:17094:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789062032.395147:0:17094:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9767f7e7a800 from MGS 00000020:01000004:3.0:1789062032.395152:0:17094:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789062032.395178:0:17094:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9766c71e19c0) 00000020:00000080:3.0:1789062032.395190:0:17094:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789062032.395282:0:17094:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767f7e7a800 from MGS, refs=2 00080000:01000000:3.0:1789062032.395288:0:17094:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789062032.395293:0:17094:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc7830 00000100:00100000:3.0:1789062032.395416:0:17094:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789062032.395566:0:17094:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789062032.395572:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789062032.396428:0:17094:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789062032.396437:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789062032.397522:0:17094:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789062032.398094:0:17094:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789062032.398101:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789062032.399216:0:17094:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789062032.399227:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789062032.399992:0:17094:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789062032.400003:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789062032.404654:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062032.404662:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062032.404664:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062032.405344:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062032.405347:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062032.405349:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062032.410780:0:17094:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789062032.412077:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789062032.419110:0:17094:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789062032.432378:0:17106:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789062032.432513:0:17094:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789062032.432769:0:17094:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789062032.440755:0:17094:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789062032.441177:0:17094:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789062032.441409:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789062032.441416:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789062032.442426:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789062032.442440:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789062032.444121:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789062032.444135:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789062032.445171:0:17094:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789062032.445198:0:17094:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.103@tcp' 00000020:01000004:2.0:1789062032.445210:0:17094:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789062032.445250:0:17094:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.103@tcp (typ=mgc) 00000020:00000080:2.0:1789062032.445266:0:17094:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.103@tcp (ffff9767fb3299c0) 00000020:00000080:2.0:1789062032.445286:0:17094:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789062032.445390:0:17094:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767fb13c000@MGC192.168.203.103@tcp: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1789062032.445634:0:17094:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.103@tcp-0 is initialized 00000040:01000000:2.0:1789062032.445642:0:17094:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789062032.450835:0:17112:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:0.0:1789062032.452338:0:17111:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1789062032.453278:0:17094:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.103@tcp (uuid 83f5b9c6-643c-4659-afe5-bacf144ade05) 00000020:00000080:2.0:1789062032.453789:0:17094:0:(genops.c:1384:class_connect()) connect: client 83f5b9c6-643c-4659-afe5-bacf144ade05, cookie 0x2774d8f311dc783e 00000100:00080000:2.0:1789062032.453805:0:17094:0:(import.c:545:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789062032.453821:0:17094:0:(import.c:666:import_select_connection()) MGC192.168.203.103@tcp: import ffff9767fb13c000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062032.453878:0:17094:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c748d180 x1875967130893952/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789062032.453903:0:17094:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 83f5b9c6-643c-4659-afe5-bacf144ade05->MGS 00000020:01000004:2.0:1789062032.453961:0:17094:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789062032.453969:0:17094:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789062032.453986:0:17094:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9767fb328000) 00000020:00000080:2.0:1789062032.454002:0:17094:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789062032.464917:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:83f5b9c6-643c-4659-afe5-bacf144ade05:3619:1875967130893952:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789062032.465019:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062032.465716:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130893952 00000100:00100000:1.0:1789062032.465728:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130893952 00000100:00100000:1.0:1789062032.465771:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789062032.465780:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3619:x1875967130893952:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789062032.465814:0:17108:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 83f5b9c6-643c-4659-afe5-bacf144ade05@0@lo t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:1.0:1789062032.465848:0:17108:0:(genops.c:1384:class_connect()) connect: client 83f5b9c6-643c-4659-afe5-bacf144ade05, cookie 0x2774d8f311dc784c 00000100:00080000:1.0:1789062032.466019:0:17108:0:(import.c:65:import_set_state_nolock()) ffff9767d02dc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789062032.466098:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+5:3619:x1875967130893952:12345-0@lo:250:mount.lustre.0 Request processed in 317us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062032.466106:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789062032.466185:0:3619:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789062032.466196:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.103@tcp: connect to target with instance 0 00000100:00080000:1.0:1789062032.469070:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789062032.469088:0:3619:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789062032.469095:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fb13c000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789062032.469100:0:3619:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789062032.469117:0:3619:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789062032.469129:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:83f5b9c6-643c-4659-afe5-bacf144ade05:3619:1875967130893952:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789062032.482535:0:17094:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789062032.483114:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789062032.483123:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789062032.485060:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789062032.485073:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789062032.486114:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789062032.486126:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789062032.487913:0:17094:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789062032.488224:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789062032.488231:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789062032.489135:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789062032.489145:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789062032.553579:0:17094:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789062032.553802:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789062032.553810:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789062032.561025:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789062032.561113:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789062032.562133:0:17094:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789062032.562379:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789062032.562385:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789062032.563404:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789062032.563414:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789062032.569166:0:17094:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789062032.569401:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789062032.569409:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789062032.571230:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789062032.571242:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789062032.572088:0:17094:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789062032.572992:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789062032.573002:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789062032.574965:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789062032.574979:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789062032.613749:0:17094:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789062032.614304:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789062032.614312:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789062032.619502:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789062032.619526:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789062032.621361:0:17094:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789062032.621377:0:17094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789062032.622573:0:17094:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789062032.624970:0:17094:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789062032.624980:0:17094:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789062032.625160:0:17094:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789062032.625199:0:17094:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789062032.625212:0:17094:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789062032.625214:0:17094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789062032.625215:0:17094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789062032.625216:0:17094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789062032.625217:0:17094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789062032.625219:0:17094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789062032.625220:0:17094:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789062032.625221:0:17094:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789062032.625223:0:17094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789062032.625224:0:17094:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789062032.625227:0:17094:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789062032.625230:0:17094:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789062032.625231:0:17094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789062032.625232:0:17094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789062032.625233:0:17094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789062032.625239:0:17094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789062032.625240:0:17094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789062032.625241:0:17094:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789062032.625242:0:17094:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789062032.625243:0:17094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789062032.625243:0:17094:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789062032.625269:0:17094:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789062032.625436:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894080:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789062032.625521:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062032.625659:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9840d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789062032.626068:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130894080 00000100:00100000:0.0:1789062032.626075:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130894080 00000100:00100000:0.0:1789062032.626153:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789062032.626162:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+5:17094:x1875967130894080:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789062032.626218:0:17110:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789062032.626221:0:17110:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789062032.626224:0:17110:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789062032.626586:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789062032.627284:0:17110:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1789062032.633724:0:17132:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789062032.633735:0:17132:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1789062032.633739:0:17132:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789062032.633742:0:17132:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789062032.634130:0:17132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789062032.634323:0:17110:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789062032.634336:0:17110:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789062032.637033:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+5:17094:x1875967130894080:12345-0@lo:253:mount.lustre.0 Request processed in 10864us (11503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062032.637054:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789062032.637172:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894080:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789062032.637187:0:17094:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789062032.637190:0:17094:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789062032.637192:0:17094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789062032.637194:0:17094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789062032.637195:0:17094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789062032.637196:0:17094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789062032.637197:0:17094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789062032.637198:0:17094:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789062032.637210:0:17094:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789062032.637212:0:17094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789062032.637225:0:17094:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789062032.637245:0:17094:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9767f7e7a800 from lustre-MDT0000 10000000:01000000:0.0:1789062032.637277:0:17094:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789062032.637280:0:17094:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789062032.637284:0:17094:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9767fb3299c0 10000000:01000000:0.0:1789062032.637288:0:17094:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789062032.637371:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9767fb3299c0 from 1 10000000:01000000:0.0:1789062032.637374:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789062032.637415:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062032.637426:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062032.637435:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062032.637454:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789062032.637559:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062032.637706:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9840d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789062032.646904:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130894208 00000100:00100000:0.0:1789062032.646920:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130894208 00000100:00100000:0.0:1789062032.647177:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789062032.647187:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+5:17094:x1875967130894208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789062032.647215:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062032.647236:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8199e00/0x2774d8f311dc785a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7853 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062032.647262:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8199e00/0x2774d8f311dc785a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7853 expref: 6 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062032.647288:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8199e00/0x2774d8f311dc785a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7853 expref: 6 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062032.647307:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199e00, rc 0) 00000100:00100000:0.0:1789062032.647387:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+6:17094:x1875967130894208:12345-0@lo:101:mount.lustre.0 Request processed in 201us (9894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062032.647394:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789062032.647484:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062032.647511:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.647520:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062032.647590:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062032.647637:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062032.648651:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c2d3ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789062032.648847:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130894336 00000100:00100000:1.0:1789062032.648853:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130894336 00000100:00100000:1.0:1789062032.648888:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789062032.648895:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+6:17094:x1875967130894336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789062032.648979:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+6:17094:x1875967130894336:12345-0@lo:501:mount.lustre.0 Request processed in 84us (1340us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789062032.648986:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789062032.649438:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894336:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789062032.649476:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789062032.649505:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.649515:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062032.649523:0:17094:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9767f7e7a800 10000000:01000000:2.0:1789062032.649528:0:17094:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789062032.649533:0:17094:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9767f7e7a800 10000000:01000000:2.0:1789062032.649545:0:17094:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789062032.649548:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9767f7e7a800 from 1 10000000:01000000:2.0:1789062032.649551:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789062032.649578:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cfa00/0x2774d8f311dc7861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.649586:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c80cfa00/0x2774d8f311dc7861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.649595:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c80cfa00/0x2774d8f311dc7861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062032.649637:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789062032.649842:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062032.649864:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c2d3ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789062032.649928:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130894464 00000100:00100000:1.0:1789062032.649933:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130894464 00000100:00100000:1.0:1789062032.649955:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789062032.649961:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+6:17094:x1875967130894464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789062032.649969:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789062032.649982:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc7868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7861 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062032.650000:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc7868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7861 expref: 7 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062032.650008:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47a000/0x2774d8f311dc7868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7861 expref: 7 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062032.650027:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a000, rc 0) 00000100:00100000:1.0:1789062032.650098:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+7:17094:x1875967130894464:12345-0@lo:101:mount.lustre.0 Request processed in 137us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062032.650112:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789062032.652401:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062032.652431:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c80cfa00/0x2774d8f311dc7861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7868 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.652444:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c80cfa00/0x2774d8f311dc7861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7868 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062032.652463:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789062032.652579:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cfa00/0x2774d8f311dc7861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7868 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.652588:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c80cfa00/0x2774d8f311dc7861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7868 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062032.652597:0:17094:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789062032.652876:0:17094:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789062032.652882:0:17094:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9767f7e7a800 10000000:01000000:2.0:1789062032.652885:0:17094:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789062032.652889:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789062032.652892:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789062032.652923:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80ce800/0x2774d8f311dc786f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.652931:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c80ce800/0x2774d8f311dc786f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.652940:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c80ce800/0x2774d8f311dc786f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062032.652958:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789062032.653014:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062032.653057:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c2d3ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789062032.653130:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130894592 00000100:00100000:3.0:1789062032.653137:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130894592 00000100:00100000:3.0:1789062032.653184:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789062032.653193:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+7:17094:x1875967130894592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789062032.653216:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062032.653230:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c807be00/0x2774d8f311dc7876 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc786f expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.653250:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c807be00/0x2774d8f311dc7876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc786f expref: 8 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.653271:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c807be00/0x2774d8f311dc7876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc786f expref: 8 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.653279:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807be00, rc 0) 00000100:00100000:3.0:1789062032.653914:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+8:17094:x1875967130894592:12345-0@lo:101:mount.lustre.0 Request processed in 719us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062032.653922:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789062032.654062:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062032.654077:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c80ce800/0x2774d8f311dc786f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7876 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.654086:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c80ce800/0x2774d8f311dc786f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7876 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062032.654390:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062032.654420:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062032.654450:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c2d3ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789062032.654518:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130894720 00000100:00100000:3.0:1789062032.654524:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130894720 00000100:00100000:3.0:1789062032.654598:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789062032.654637:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+8:17094:x1875967130894720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062032.655046:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+9:17094:x1875967130894720:12345-0@lo:501:mount.lustre.0 Request processed in 440us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062032.655053:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789062032.655136:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062032.655176:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789062032.655221:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062032.656078:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c2d3ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789062032.656166:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130894848 00000100:00100000:0.0:1789062032.656173:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130894848 00000100:00100000:1.0:1789062032.656223:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789062032.656233:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+9:17094:x1875967130894848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789062032.657373:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+9:17094:x1875967130894848:12345-0@lo:503:mount.lustre.0 Request processed in 1138us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062032.657383:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789062032.658014:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130894848:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789062032.659074:0:17133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8173800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17133:1875967130894976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789062032.659370:0:17133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062032.659411:0:17133:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7494780 going to sleep for 11 seconds 00000100:00100000:3.0:1789062032.659472:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130894976 00000100:00100000:3.0:1789062032.659479:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130894976 00000100:00100000:3.0:1789062032.659914:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789062032.659925:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+9:17133:x1875967130894976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789062032.660982:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+9:17133:x1875967130894976:12345-0@lo:502:llog_process_th.0 Request processed in 1056us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062032.660993:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789062032.661097:0:17133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8173800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17133:1875967130894976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789062032.661132:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062032.661144:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.661146:0:17133:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789062032.661151:0:17133:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789062032.661154:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789062032.661168:0:17133:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9767f7e58000) 00000020:00000080:1.0:1789062032.661185:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789062032.661190:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789062032.661285:0:17133:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789062032.661375:0:17133:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc7884 00000020:00000080:1.0:1789062032.661948:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789062032.661953:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062032.661957:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.661965:0:17133:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789062032.661968:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062032.661972:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.661973:0:17133:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789062032.661976:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789062032.661986:0:17133:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9767f7e5b380) 00000020:00000080:1.0:1789062032.661997:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789062032.662001:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789062032.662004:0:17133:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789062032.662006:0:17133:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789062032.662012:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789062032.662065:0:17133:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767f7e7a800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789062032.662078:0:17133:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9767f7e5cd40) 00000020:00000080:1.0:1789062032.662089:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789062032.662132:0:17133:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789062032.662137:0:17133:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc7899 00000020:00000080:1.0:1789062032.662242:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789062032.662248:0:17133:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789062032.662252:0:17133:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2774d8f311dc78a0 00080000:01000000:1.0:1789062032.662258:0:17133:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789062032.662261:0:17133:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc78a7 00010000:00010000:3.0:1789062032.756085:0:17133:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789062032.756567:0:17133:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1789062032.757163:0:17133:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789062032.757859:0:17133:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9766c71e0000) 00000020:00000080:3.0:1789062032.757878:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789062032.757954:0:17133:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789062032.757962:0:17133:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc78b5 00000020:00000080:2.0:1789062032.758909:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789062032.764897:0:17133:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2774d8f311dc78bc 00000020:00000080:2.0:1789062032.766007:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789062032.766019:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789062032.766025:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062032.766027:0:17133:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789062032.766031:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789062032.766034:0:17133:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1789062032.766036:0:17133:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789062032.766038:0:17133:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789062032.766039:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789062032.766042:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062032.766043:0:17133:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789062032.766045:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789062032.766050:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062032.766051:0:17133:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789062032.766055:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789062032.766097:0:17133:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789062032.766113:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789062032.766115:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062032.766117:0:17133:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789062032.766119:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789062032.766122:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062032.766124:0:17133:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789062032.766127:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789062032.766132:0:17133:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:2.0:1789062032.766157:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789062032.766176:0:17133:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9767fb32b380) 00000020:00000080:2.0:1789062032.766190:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789062032.766195:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789062032.766256:0:17133:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789062032.766261:0:17133:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789062032.766267:0:17133:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc78ca 00010000:00080000:2.0:1789062032.766303:0:17133:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767fff32000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1789062032.770480:0:17133:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789062032.773969:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789062032.773985:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789062032.774017:0:17133:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789062032.774034:0:17133:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc78d1 00000100:00080000:1.0:1789062032.774044:0:17133:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789062032.774054:0:17133:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9767fff32000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062032.774088:0:17133:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c8173800 x1875967130895104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789062032.774150:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130895104:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789062032.774224:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789062032.774280:0:17133:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789062032.774358:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062032.774362:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.774371:0:17133:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789062032.774374:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789062032.774377:0:17133:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789062032.774379:0:17133:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789062032.774380:0:17133:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789062032.774381:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789062032.774383:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.774385:0:17133:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789062032.774387:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789062032.774392:0:17133:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789062032.774395:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.774397:0:17133:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789062032.774399:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789062032.774403:0:17133:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:1.0:1789062032.774421:0:17133:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789062032.774424:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789062032.774436:0:17133:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9767f7e599c0) 00000020:00000080:1.0:1789062032.774448:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789062032.774452:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789062032.774515:0:17133:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789062032.774521:0:17133:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789062032.774527:0:17133:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc78df 00010000:00080000:1.0:1789062032.774561:0:17133:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767c3f63000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1789062032.774910:0:17133:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1789062032.775670:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130895104 00000100:00100000:2.0:1789062032.775679:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130895104 00000100:00100000:2.0:1789062032.775717:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789062032.775725:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875967130895104:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789062032.775741:0:17120:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1789062032.779499:0:17133:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789062032.780257:0:17133:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789062032.783384:0:17133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789062032.783810:0:17133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789062032.790849:0:17133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789062032.791468:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789062032.791473:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789062032.792947:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789062032.792961:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789062032.793000:0:17133:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789062032.793022:0:17133:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc78e6 00000100:00080000:1.0:1789062032.793032:0:17133:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789062032.793044:0:17133:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9767c3f63000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062032.793088:0:17133:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c8172d80 x1875967130895232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789062032.793117:0:17133:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789062032.793168:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062032.793172:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.793174:0:17133:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789062032.793177:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789062032.793180:0:17133:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789062032.793181:0:17133:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789062032.793183:0:17133:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789062032.793184:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789062032.793187:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.793188:0:17133:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789062032.793190:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789062032.793194:0:17133:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789062032.793196:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.793198:0:17133:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789062032.793212:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789062032.793215:0:17133:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:1.0:1789062032.793236:0:17133:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789062032.793239:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789062032.793250:0:17133:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9767f7e94d40) 00000020:00000080:1.0:1789062032.793262:0:17133:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789062032.793266:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1789062032.793756:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130895232:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789062032.793822:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875967130895232 offset 0 length 520: 4 00000004:00080000:1.0:1789062032.794832:0:17133:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789062032.794839:0:17133:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789062032.794849:0:17133:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2774d8f311dc78f4 00010000:00080000:1.0:1789062032.794880:0:17133:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767c3f65800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1789062032.795108:0:17133:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789062032.795171:0:17133:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789062032.795185:0:17133:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789062032.802540:0:17133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789062032.805421:0:17133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789062032.805791:0:17133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1789062032.808228:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875967130895104:12345-0@lo:38:llog_process_th.0 Request processed in 32497us (33999us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789062032.808264:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789062032.808410:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fff32000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062032.808417:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789062032.808421:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130895104:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789062032.809134:0:17141:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789062032.809140:0:17141:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789062032.810376:0:17133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789062032.810390:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789062032.810431:0:17133:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789062032.810451:0:17133:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc78fb 00000100:00080000:1.0:1789062032.810460:0:17133:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789062032.810470:0:17133:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9767c3f65800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062032.810505:0:17133:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c8173800 x1875967130895360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789062032.810564:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130895360:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789062032.810854:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875967130895360 offset 0 length 520: 4 00000100:00080000:1.0:1789062032.810918:0:17133:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789062032.810977:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062032.810982:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.810984:0:17133:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789062032.810986:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062032.810990:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.810991:0:17133:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789062032.810994:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789062032.810996:0:17133:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789062032.810998:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062032.811000:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.811002:0:17133:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789062032.811004:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062032.811006:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.811007:0:17133:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789062032.811011:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789062032.811041:0:17133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17133:1875967130895488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789062032.811103:0:17133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062032.811122:0:17133:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789062032.811908:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130895488 00000100:00100000:2.0:1789062032.811917:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130895488 00000100:00100000:2.0:1789062032.812004:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789062032.812014:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+9:17133:x1875967130895488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789062032.812192:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+9:17133:x1875967130895488:12345-0@lo:502:llog_process_th.0 Request processed in 179us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062032.812210:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789062032.812316:0:17133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17133:1875967130895488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789062032.812342:0:17133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062032.812347:0:17133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.812349:0:17133:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789062032.812354:0:17133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789062032.812573:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1789062032.813830:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789062032.813850:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80ce800/0x2774d8f311dc786f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7876 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.813863:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c80ce800/0x2774d8f311dc786f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7876 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789062032.813872:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767f7e7a800 from 1 10000000:01000000:3.0:1789062032.813875:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789062032.813915:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.813923:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.813933:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062032.813953:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130895616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789062032.814002:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062032.814036:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789062032.814176:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130895616 00000100:00100000:2.0:1789062032.814184:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130895616 00000100:00100000:2.0:1789062032.814240:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789062032.814249:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+9:17094:x1875967130895616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062032.814262:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062032.814276:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7902 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.814326:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7902 expref: 10 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.814337:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7902 expref: 10 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.814345:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce000, rc 0) 00000100:00100000:2.0:1789062032.814380:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+10:17094:x1875967130895616:12345-0@lo:101:mount.lustre.0 Request processed in 133us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062032.814387:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789062032.814539:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130895616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789062032.814552:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7909 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.814562:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7909 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062032.815113:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130895744:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789062032.815153:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062032.815181:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789062032.815415:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130895744 00000100:00100000:2.0:1789062032.815420:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130895744 00000100:00100000:2.0:1789062032.815454:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789062032.815461:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+10:17094:x1875967130895744:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789062032.815475:0:17109:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789062032.815480:0:17109:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789062032.815541:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+10:17094:x1875967130895744:12345-0@lo:256:mount.lustre.0 Request processed in 80us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062032.815548:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789062032.815766:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130895744:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789062032.816586:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789062032.816801:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7909 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.816813:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7909 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789062032.816822:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767f7e7a800 from 1 10000000:01000000:3.0:1789062032.816825:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789062032.816854:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.816861:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.816870:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062032.816941:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130895872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789062032.816985:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062032.817013:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789062032.817147:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130895872 00000100:00100000:2.0:1789062032.817153:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130895872 00000100:00100000:2.0:1789062032.817197:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789062032.817215:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+10:17094:x1875967130895872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062032.817227:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062032.817240:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c80cf600/0x2774d8f311dc7917 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7910 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.817271:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c80cf600/0x2774d8f311dc7917 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7910 expref: 11 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.817281:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c80cf600/0x2774d8f311dc7917 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7910 expref: 11 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.817289:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cf600, rc 0) 00000100:00100000:2.0:1789062032.817334:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+11:17094:x1875967130895872:12345-0@lo:101:mount.lustre.0 Request processed in 121us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062032.817341:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789062032.817540:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130895872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789062032.817552:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7917 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.817561:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7917 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062032.817810:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130896000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062032.817840:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062032.817868:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789062032.817883:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130896000 00000100:00100000:3.0:1789062032.817887:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130896000 00000100:00100000:3.0:1789062032.817917:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789062032.817924:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+11:17094:x1875967130896000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062032.818042:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+11:17094:x1875967130896000:12345-0@lo:501:mount.lustre.0 Request processed in 118us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062032.818048:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789062032.818080:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130896000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062032.818104:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130896128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789062032.818143:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062032.818156:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789062032.818174:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130896128 00000100:00100000:3.0:1789062032.818178:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130896128 00000100:00100000:3.0:1789062032.818194:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789062032.818211:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+11:17094:x1875967130896128:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789062032.818284:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+11:17094:x1875967130896128:12345-0@lo:503:mount.lustre.0 Request processed in 85us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062032.818402:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789062032.818444:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130896128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789062032.819022:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17143:1875967130896256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789062032.819063:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062032.819128:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789062032.819163:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130896256 00000100:00100000:0.0:1789062032.819168:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130896256 00000100:00100000:0.0:1789062032.819209:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789062032.819218:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+11:17143:x1875967130896256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789062032.820037:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+11:17143:x1875967130896256:12345-0@lo:502:llog_process_th.0 Request processed in 818us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062032.820052:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789062032.820120:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17143:1875967130896256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789062032.820146:0:17143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062032.820154:0:17143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.820156:0:17143:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789062032.820165:0:17143:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767f7e7a800 00000020:00000080:1.0:1789062032.820167:0:17143:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789062032.820175:0:17143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062032.820178:0:17143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.820179:0:17143:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789062032.820182:0:17143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062032.820184:0:17143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.820186:0:17143:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789062032.820190:0:17143:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767f7e7a800 00000020:00000080:1.0:1789062032.820192:0:17143:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789062032.820359:0:17143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062032.820363:0:17143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.820365:0:17143:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789062032.820369:0:17143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062032.820371:0:17143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.820373:0:17143:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789062032.820384:0:17143:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767f7e7a800 00000020:00000080:1.0:1789062032.820386:0:17143:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789062032.824735:0:17143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062032.824747:0:17143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.824749:0:17143:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789062032.824754:0:17143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062032.824758:0:17143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.824759:0:17143:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789062032.824764:0:17143:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767f7e7a800 00000020:00000080:1.0:1789062032.824766:0:17143:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789062032.824849:0:17143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17143:1875967130896384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789062032.824924:0:17143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062032.824969:0:17143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c65a0600 going to sleep for 11 seconds 00000100:00100000:2.0:1789062032.825095:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130896384 00000100:00100000:2.0:1789062032.825102:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130896384 00000100:00100000:2.0:1789062032.825146:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789062032.825154:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+11:17143:x1875967130896384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789062032.826190:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+11:17143:x1875967130896384:12345-0@lo:502:llog_process_th.0 Request processed in 1034us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062032.826211:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789062032.826383:0:17143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17143:1875967130896384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789062032.826413:0:17143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062032.826419:0:17143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062032.826421:0:17143:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789062032.826425:0:17143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789062032.829172:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789062032.829223:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789062032.829280:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7917 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.829293:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7917 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062032.829349:0:17094:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789062032.829353:0:17094:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9767f7e7a800 10000000:01000000:2.0:1789062032.829361:0:17094:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9767f7e7a800 10000000:01000000:2.0:1789062032.829366:0:17094:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789062032.829371:0:17094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767f7e7a800 from 1 10000000:01000000:2.0:1789062032.829374:0:17094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789062032.829408:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cfc00/0x2774d8f311dc791e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.829416:0:17094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c80cfc00/0x2774d8f311dc791e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.829426:0:17094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c80cfc00/0x2774d8f311dc791e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062032.829446:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130896512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789062032.829513:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062032.829548:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130896512 00000100:00100000:0.0:1789062032.829555:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130896512 00000100:00100000:2.0:1789062032.829560:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c37143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789062032.831502:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789062032.831517:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+11:17094:x1875967130896512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789062032.831533:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062032.831550:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8198400/0x2774d8f311dc7925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc791e expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062032.831583:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8198400/0x2774d8f311dc7925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc791e expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062032.831595:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8198400/0x2774d8f311dc7925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc791e expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062032.831616:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198400, rc 0) 00000100:00100000:0.0:1789062032.832414:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17094:x1875967130896512:12345-0@lo:101:mount.lustre.0 Request processed in 900us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062032.832422:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789062032.832503:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130896512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062032.832522:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c80cfc00/0x2774d8f311dc791e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7925 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.832532:0:17094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c80cfc00/0x2774d8f311dc791e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7925 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062032.832604:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130896640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062032.832665:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062032.832922:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c37143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062032.832961:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130896640 00000100:00100000:1.0:1789062032.832967:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130896640 00000100:00100000:1.0:1789062032.832995:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789062032.833002:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17094:x1875967130896640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789062032.833117:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17094:x1875967130896640:12345-0@lo:501:mount.lustre.0 Request processed in 115us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062032.833124:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789062032.833256:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130896640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062032.833282:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130896768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789062032.833400:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062032.833454:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c37143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062032.834397:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130896768 00000100:00100000:1.0:1789062032.834404:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130896768 00000100:00100000:1.0:1789062032.834490:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789062032.834499:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17094:x1875967130896768:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789062032.835454:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17094:x1875967130896768:12345-0@lo:503:mount.lustre.0 Request processed in 953us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062032.835464:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789062032.835551:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130896768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789062032.837406:0:17148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17148:1875967130896896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789062032.837884:0:17148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062032.837921:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130896896 00000100:00100000:1.0:1789062032.837928:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130896896 00000100:00100000:1.0:1789062032.837972:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789062032.837981:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17148:x1875967130896896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789062032.838093:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17148:x1875967130896896:12345-0@lo:502:llog_process_th.0 Request processed in 113us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062032.838100:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789062032.838149:0:17148:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062032.838166:0:17148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17148:1875967130896896:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789062032.838236:0:17148:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789062032.838250:0:17148:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9767f7e919c0) 00000020:00000080:1.0:1789062032.838267:0:17148:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789062032.838344:0:17148:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767f7e7a800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789062032.838348:0:17148:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767f7e7a800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789062032.838350:0:17148:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767f7e7a800 4 00010000:00080000:1.0:1789062032.838379:0:17148:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9766c809f000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1789062032.841149:0:17148:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789062032.841350:0:17148:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789062032.841392:0:17148:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789062032.841405:0:17148:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2774d8f311dc7933 00000100:00080000:1.0:1789062032.841414:0:17148:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789062032.841431:0:17148:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9766c809f000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062032.841465:0:17148:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c8171180 x1875967130897024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789062032.841493:0:17148:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789062032.842342:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875967130897024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789062032.842407:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062032.842771:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130897024 00000100:00100000:1.0:1789062032.842778:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130897024 00000100:00100000:1.0:1789062032.842810:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789062032.842817:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875967130897024:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789062032.842870:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875967130897024:12345-0@lo:38:llog_process_th.0 Request processed in 52us (462us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789062032.842877:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789062032.842926:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789062032.842933:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9766c809f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062032.842937:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789062032.842941:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875967130897024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789062032.843277:0:17148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17148:1875967130897152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789062032.843339:0:17148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062032.843367:0:17148:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c37143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062032.843408:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130897152 00000100:00100000:1.0:1789062032.843413:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130897152 00000100:00100000:1.0:1789062032.843445:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789062032.843452:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17148:x1875967130897152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789062032.843858:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17148:x1875967130897152:12345-0@lo:502:llog_process_th.0 Request processed in 405us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062032.843865:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789062032.843920:0:17148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17148:1875967130897152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789062032.843953:0:17148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17148:1875967130897280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789062032.843980:0:17148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062032.844030:0:17148:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c37143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062032.844058:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130897280 00000100:00100000:1.0:1789062032.844062:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130897280 00000100:00100000:1.0:1789062032.844111:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789062032.844118:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17148:x1875967130897280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789062032.844188:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17148:x1875967130897280:12345-0@lo:502:llog_process_th.0 Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062032.844194:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789062032.844196:0:17148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:83f5b9c6-643c-4659-afe5-bacf144ade05:17148:1875967130897280:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789062032.844225:0:17148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789062032.844354:0:17094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789062032.844378:0:17094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789062032.844395:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cfc00/0x2774d8f311dc791e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7925 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.844406:0:17094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c80cfc00/0x2774d8f311dc791e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7925 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789062032.844446:0:17094:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789062032.844448:0:17094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789062032.844449:0:17094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789062032.844451:0:17094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789062032.844452:0:17094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789062032.844453:0:17094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789062032.844454:0:17094:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789062032.844455:0:17094:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789062032.844457:0:17094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789062032.844458:0:17094:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789062032.844462:0:17094:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789062032.844467:0:17094:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789062032.844469:0:17094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789062032.844470:0:17094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789062032.844471:0:17094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789062032.844471:0:17094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789062032.844472:0:17094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789062032.844473:0:17094:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789062032.844474:0:17094:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789062032.844475:0:17094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789062032.844476:0:17094:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789062032.844489:0:17094:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789062032.844497:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130897408:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789062032.844527:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062032.844549:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c3714e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789062032.844589:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130897408 00000100:00100000:1.0:1789062032.844593:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130897408 00000100:00100000:1.0:1789062032.844794:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789062032.844801:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17094:x1875967130897408:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789062032.844819:0:17110:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789062032.844831:0:17110:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789062032.846870:0:17110:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789062032.846912:0:17110:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789062032.847133:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17094:x1875967130897408:12345-0@lo:253:mount.lustre.0 Request processed in 2329us (2601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062032.847144:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789062032.847214:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17094:1875967130897408:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789062032.847229:0:17094:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789062032.847232:0:17094:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789062032.847234:0:17094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789062032.847235:0:17094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789062032.847236:0:17094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789062032.847237:0:17094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789062032.847238:0:17094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789062032.847239:0:17094:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789062032.847241:0:17094:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789062032.847242:0:17094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789062032.847243:0:17094:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789062032.847257:0:17094:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789062032.849843:0:17131:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789062032.849853:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789062032.849873:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.849890:0:17131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7902 expref: 11 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.849898:0:17131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.849935:0:17131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7902 expref: 11 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.849950:0:17131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7909 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7902 expref: 11 pid: 17109 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062032.849963:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130897536:0@lo:104: 00000100:00100000:3.0:1789062032.850020:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062032.850066:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789062032.850679:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130897536 00000100:00100000:3.0:1789062032.850687:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130897536 00000100:00100000:3.0:1789062032.850729:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789062032.850737:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+3:17131:x1875967130897536:12345-0@lo:104: 00010000:00010000:3.0:1789062032.850749:0:17098:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7909 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062032.850802:0:17098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789062032.850807:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+3:17131:x1875967130897536:12345-0@lo:104: Request processed in 73us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062032.850814:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789062032.850849:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130897536:0@lo:104: 00010000:00010000:3.0:1789062032.850866:0:17131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.853432:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789062032.853442:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7909 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.853461:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807ae00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789062032.853466:0:17104:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7909 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.853475:0:17104:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7909 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789062032.853482:0:17104:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7909 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062032.853488:0:17104:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789062032.853540:0:17104:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7909 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.853546:0:17104:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789062032.853574:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7909 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.853581:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c807ae00/0x2774d8f311dc7902 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7909 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.853595:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062032.853597:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062032.853599:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062032.853728:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83f5b9c6-643c-4659-afe5-bacf144ade05:3621:1875967130897664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789062032.853787:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062032.854676:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130897664 00000100:00100000:2.0:1789062032.854684:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130897664 00010000:00010000:2.0:1789062032.854710:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7909 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7902 expref: 12 pid: 17109 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062032.854738:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789062032.854752:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+12:3621:x1875967130897664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789062032.854764:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789062032.854769:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7909 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7902 expref: 12 pid: 17109 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854779:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7902 expref: 12 pid: 17109 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854791:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7902 expref: 12 pid: 17109 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854804:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854812:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789062032.854825:0:17100:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004973278s 00010000:00010000:2.0:1789062032.854829:0:17100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854835:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854842:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854849:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854854:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b400 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062032.854863:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854870:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854890:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854900:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789062032.854945:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+11:3621:x1875967130897664:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062032.854953:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789062032.854979:0:17131:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854987:0:17131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062032.854992:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c807b400/0x2774d8f311dc793a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062032.855027:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83f5b9c6-643c-4659-afe5-bacf144ade05:3621:1875967130897664:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789062032.860189:0:17094:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789062032.860587:0:17094:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789062032.860838:0:17154:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789062032.860842:0:17154:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789062032.861134:0:17155:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789062032.861283:0:17094:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1789062032.862131:0:17156:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9766c8171180 x1875967130897792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062032.862143:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00000040:00080000:1.0:1789062032.862970:0:17155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789062032.864147:0:17094:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789062032.864193:0:17094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789062032.864603:0:17094:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789062032.864626:0:17094:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789062032.866444:0:17094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789062032.869408:0:17094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789062032.869992:0:17094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789062032.870027:0:17094:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789062032.871150:0:17155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789062032.871220:0:17155:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1789062032.873540:0:17094:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1789062032.874995:0:17094:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1789062032.877892:0:17094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789062032.879816:0:17094:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789062032.879849:0:17094:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc8840d7f988 00100000:10000000:2.0:1789062032.879856:0:17094:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789062032.880674:0:17094:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789062032.880694:0:17094:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789062032.880713:0:17094:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1789062032.880878:0:17094:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789062032.881914:0:17094:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789062032.882085:0:17094:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789062033.454173:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789062033.898841:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00000040:00080000:1.0:1789062033.899228:0:17149:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789062033.899233:0:17149:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789062033.900410:0:17149:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1789062033.900420:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1789062033.961722:0:17112:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789062033.961729:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767f7e7a800 from 7 10000000:01000000:2.0:1789062033.961735:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789062033.961775:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062033.961787:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062033.961798:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062033.961823:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130897920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789062033.961930:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062033.961982:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d11ce180 going to sleep for 11 seconds 00000100:00100000:1.0:1789062033.962032:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130897920 00000100:00100000:1.0:1789062033.962039:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130897920 00000100:00100000:1.0:1789062033.962095:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789062033.962104:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+11:17112:x1875967130897920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789062033.962117:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789062033.962130:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc7948 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7941 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062033.962164:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc7948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7941 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062033.962174:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc7948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7941 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062033.962183:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b200, rc 0) 00000100:00100000:1.0:1789062033.962243:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17112:x1875967130897920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062033.962249:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789062033.962335:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130897920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789062033.962351:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7948 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062033.962360:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7948 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062033.962420:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130898048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789062033.962451:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062033.962473:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c2e29600 going to sleep for 11 seconds 00000100:00100000:1.0:1789062033.962512:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130898048 00000100:00100000:1.0:1789062033.962516:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130898048 00000100:00100000:1.0:1789062033.962546:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789062033.962552:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17112:x1875967130898048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789062033.962564:0:17110:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789062033.962580:0:17110:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789062033.962583:0:17110:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789062033.962675:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17112:x1875967130898048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062033.962681:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789062033.962707:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130898048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789062033.962748:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789062033.962754:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7948 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062033.962762:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7948 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062034.475456:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789062034.921793:0:17149:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789062034.921801:0:17149:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789062034.921918:0:17149:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789062034.922159:0:17149:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789062034.922297:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:1.0:1789062034.922797:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00010000:00010000:2.0:1789062035.501712:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062035.950332:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00010000:00010000:1.0:1789062036.522149:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062036.971370:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00000001:02000400:0.0:1789062037.477120:0:17399:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789062037.550982:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062037.993793:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00000100:00100000:0.0:1789062038.192956:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1789062038.193933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789062038.193940:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789062038.193942:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767fff32000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789062038.193950:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:3.0:1789062038.193956:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789062038.193968:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9767fff32000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1789062038.193998:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c83e1180 x1875967130898304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789062038.194015:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789062038.194019:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789062038.194021:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789062038.194039:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789062038.194041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789062038.194045:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789062038.194047:0:36:0:(import.c:65:import_set_state_nolock()) ffff9766c809f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789062038.194053:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9766c809f000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1789062038.194067:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c83e2d80 x1875967130898432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789062038.194149:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130898304:0@lo:38:kworker.0 00000100:00100000:2.0:1789062038.194263:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062038.194318:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875967130898432:0@lo:38:kworker.0 00000100:00100000:2.0:1789062038.194345:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062038.195093:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130898304 00000100:00100000:3.0:1789062038.195102:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130898304 00000100:00100000:3.0:1789062038.195131:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789062038.195138:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875967130898304:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789062038.195156:0:17121:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789062038.199586:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130898176:0@lo:400:kworker.0 00000100:00100000:0.0:1789062038.199666:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062038.199753:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130898432 00000100:00100000:0.0:1789062038.199761:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130898432 00000100:00100000:0.0:1789062038.199794:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789062038.199801:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875967130898432:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789062038.199830:0:17117:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:0.0:1789062038.199862:0:17117:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2774d8f311dc794f 00000004:00100000:0.0:1789062038.199875:0:17117:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789062038.199982:0:17117:0:(import.c:65:import_set_state_nolock()) ffff9767c5d2b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789062038.200032:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875967130898432:12345-0@lo:38:kworker.0 Request processed in 230us (5685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062038.200038:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789062038.200124:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130898176 00000100:00100000:2.0:1789062038.200128:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130898176 00000100:00100000:2.0:1789062038.200174:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789062038.200181:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+12:3623:x1875967130898176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062038.200215:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+12:3623:x1875967130898176:12345-0@lo:400:kworker.0 Request processed in 35us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062038.200220:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789062038.205705:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9766c83e2d80 x1875967130898432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789062048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789062038.205726:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789062038.205734:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789062038.205739:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789062038.205743:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9766c809f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789062038.205749:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875967130898432:0@lo:38:kworker.0 00000100:00100000:1.0:1789062038.213046:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130898176:0@lo:400:kworker.0 00000100:00100000:3.0:1789062038.243241:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875967130898304:12345-0@lo:38:kworker.0 Request processed in 48092us (48968us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789062038.243255:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789062038.243525:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fff32000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789062038.243531:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789062038.243535:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130898304:0@lo:38:kworker.0 00010000:00010000:1.0:1789062038.569776:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789062038.594487:0:17451:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789062038.594726:0:17451:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789062039.018335:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00000020:00000004:3.0:1789062039.556439:0:17501:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789062039.559601:0:17501:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789062039.594864:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062040.044595:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00010000:00010000:3.0:1789062040.620128:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062041.065877:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00010000:00010000:2.0:1789062041.643708:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062042.090601:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00000100:00100000:2.0:1789062042.285768:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789062032/real 1789062032] req@ffff9766c8173800 x1875967130895360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062042.285800:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766c8173800 x1875967130895360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062042.285810:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789062032/real 1789062032] req@ffff9766c8172d80 x1875967130895232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062042.285822:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766c8172d80 x1875967130895232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789062042.285839:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789062042.285861:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789062042.285864:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130895360:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789062042.285870:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f63000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789062042.285875:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789062042.285878:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130895232:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789062042.285970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789062042.285974:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789062042.285976:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767fff32000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789062042.285981:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:2.0:1789062042.285986:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789062042.285996:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9767fff32000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062042.286014:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c748df80 x1875967130898688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789062042.286028:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062042.286031:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789062042.286032:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f63000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789062042.286035:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:2.0:1789062042.286038:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789062042.286042:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9767c3f63000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062042.286054:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c748ca80 x1875967130898816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789062042.286062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062042.286065:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789062042.286066:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789062042.286069:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:2.0:1789062042.286071:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789062042.286074:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9767c3f65800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062042.286084:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c748ea00 x1875967130898944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789062042.286149:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130898560:0@lo:400:kworker.0 00000100:00100000:2.0:1789062042.286211:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062042.286274:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130899072:0@lo:400:kworker.0 00000100:00100000:2.0:1789062042.286301:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062042.286347:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130898560 00000100:00100000:2.0:1789062042.286354:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130898560 00000100:00100000:2.0:1789062042.286397:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789062042.286405:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+12:3623:x1875967130898560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062042.286564:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130899072 00000100:00100000:0.0:1789062042.286569:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130899072 00000100:00100000:0.0:1789062042.286594:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789062042.286600:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130899072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062042.286681:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130899072:12345-0@lo:400:kworker.0 Request processed in 80us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062042.286687:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789062042.286809:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+12:3623:x1875967130898560:12345-0@lo:400:kworker.0 Request processed in 404us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062042.286816:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789062042.286858:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9766c748d180 x1875967130899072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062042.286870:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130899072:0@lo:400:kworker.0 00000100:00100000:2.0:1789062042.286888:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130898688:0@lo:38:kworker.0 00000100:00100000:2.0:1789062042.286914:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062042.286941:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130898816:0@lo:8:kworker.0 00000400:00000100:2.0:1789062042.286962:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875967130898816 offset 0 length 520: 4 00000100:00100000:2.0:1789062042.286973:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130898944:0@lo:8:kworker.0 00000400:00000100:2.0:1789062042.286989:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875967130898944 offset 0 length 520: 4 00000100:00100000:2.0:1789062042.287009:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130898688 00000100:00100000:2.0:1789062042.287013:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130898688 00000100:00100000:2.0:1789062042.287035:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789062042.287048:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875967130898688:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789062042.287064:0:17120:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789062042.287442:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130898560:0@lo:400:kworker.0 00000100:00100000:0.0:1789062042.324121:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875967130898688:12345-0@lo:38:kworker.0 Request processed in 37066us (37199us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789062042.324151:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789062042.324639:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fff32000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789062042.324646:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789062042.324651:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130898688:0@lo:38:kworker.0 00010000:00010000:1.0:1789062042.670976:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062043.114694:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00010000:00010000:1.0:1789062043.689741:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062044.138666:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00000040:00080000:2.0:1789062044.140534:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789062044.714182:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062045.162429:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00010000:00010000:1.0:1789062045.740889:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789062046.005340:0:17846:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789062046.005344:0:17846:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789062046.005345:0:17846:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789062046.005459:0:17846:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9767fb2fe000 00000020:01000004:3.0:1789062046.005474:0:17846:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1789062046.005485:0:17846:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789062046.005498:0:17846:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9766c71e3380) 00000020:00000080:3.0:1789062046.005515:0:17846:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789062046.108918:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1789062046.109371:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789062046.116117:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789062046.116675:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789062046.116913:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789062046.117159:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789062046.117393:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789062046.119731:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789062046.120078:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789062046.120297:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789062046.120660:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789062046.120850:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789062046.121583:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789062046.122200:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789062046.124647:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789062046.124922:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1789062046.125239:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1789062046.126015:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789062046.126275:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789062046.126578:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789062046.126843:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789062046.127037:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1789062046.127768:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1789062046.128088:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1789062046.128696:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789062046.128956:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789062046.129210:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789062046.129633:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1789062046.129861:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1789062046.130056:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789062046.130315:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1789062046.136811:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789062046.137213:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789062046.137600:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789062046.137816:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789062046.138957:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789062046.139220:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789062046.139597:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789062046.140576:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789062046.140955:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789062046.141205:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789062046.141406:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789062046.141945:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789062046.142149:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789062046.142739:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789062046.143574:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00080000:01000000:2.0:1789062046.145150:0:17846:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789062046.145381:0:17846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789062046.145395:0:17846:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789062046.145406:0:17846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2774d8f311dc795d 00000020:01000004:2.0:1789062046.145413:0:17846:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789062046.145798:0:17846:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789062046.145802:0:17846:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789062046.145808:0:17846:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789062046.145834:0:17846:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789062046.145838:0:17846:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789062046.155813:0:17846:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789062046.155858:0:17846:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789062046.155862:0:17846:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789062046.155863:0:17846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789062046.155865:0:17846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789062046.155866:0:17846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789062046.155867:0:17846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789062046.155868:0:17846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789062046.155869:0:17846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789062046.155871:0:17846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789062046.155873:0:17846:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789062046.155877:0:17846:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789062046.155880:0:17846:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789062046.155881:0:17846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789062046.155882:0:17846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789062046.155883:0:17846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789062046.155884:0:17846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789062046.155885:0:17846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789062046.155886:0:17846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789062046.155887:0:17846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789062046.155888:0:17846:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789062046.155914:0:17846:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789062046.155932:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899200:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789062046.156003:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062046.156132:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5a5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789062046.156223:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130899200 00000100:00100000:1.0:1789062046.156230:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130899200 00000100:00100000:3.0:1789062046.156404:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789062046.156414:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17846:x1875967130899200:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789062046.156471:0:17108:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789062046.156474:0:17108:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1789062046.156481:0:17108:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789062046.156867:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17846:x1875967130899200:12345-0@lo:253:mount.lustre.0 Request processed in 453us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062046.156875:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789062046.156959:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899200:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789062046.156970:0:17846:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789062046.156972:0:17846:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789062046.156974:0:17846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789062046.156975:0:17846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789062046.156976:0:17846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789062046.156978:0:17846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789062046.156979:0:17846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789062046.156981:0:17846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789062046.156989:0:17846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789062046.156990:0:17846:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789062046.157007:0:17846:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9767fb2fe000 from lustre-MDT0001 10000000:01000000:0.0:1789062046.157036:0:17846:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789062046.157038:0:17846:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789062046.157045:0:17846:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9767fb3299c0 local copy 00010000:00010000:0.0:1789062046.157055:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062046.157150:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789062046.157180:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062046.157391:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d0193900 going to sleep for 11 seconds 00000100:00100000:2.0:1789062046.157716:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130899328 00000100:00100000:2.0:1789062046.157722:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130899328 00000100:00100000:3.0:1789062046.157823:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789062046.157832:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17846:x1875967130899328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062046.157910:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17846:x1875967130899328:12345-0@lo:501:mount.lustre.0 Request processed in 78us (728us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789062046.157917:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789062046.157994:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899328:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789062046.158009:0:17846:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789062046.158038:0:17846:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789062046.158045:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.158054:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062046.158085:0:17846:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9767fb2fe000 10000000:01000000:2.0:1789062046.158090:0:17846:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789062046.158095:0:17846:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9767fb3299c0 10000000:01000000:2.0:1789062046.158098:0:17846:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789062046.158101:0:17846:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9767fb3299c0 from 1 10000000:01000000:2.0:1789062046.158104:0:17846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789062046.158138:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc7964 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.158146:0:17846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc7964 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.158154:0:17846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc7964 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062046.158168:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789062046.158196:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062046.158225:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5a5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789062046.158276:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130899456 00000100:00100000:0.0:1789062046.158280:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130899456 00000100:00100000:0.0:1789062046.158299:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789062046.158304:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+12:17846:x1875967130899456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789062046.158313:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062046.158325:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8198800/0x2774d8f311dc796b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7964 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062046.158344:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8198800/0x2774d8f311dc796b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7964 expref: 13 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062046.158355:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8198800/0x2774d8f311dc796b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7964 expref: 13 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062046.158364:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198800, rc 0) 00000100:00100000:0.0:1789062046.158398:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+13:17846:x1875967130899456:12345-0@lo:101:mount.lustre.0 Request processed in 93us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062046.158405:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789062046.158680:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062046.158693:0:17846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc7964 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc796b expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.158701:0:17846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc7964 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc796b expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062046.158723:0:17846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789062046.158735:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc7964 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc796b expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.158741:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c80cf400/0x2774d8f311dc7964 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc796b expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062046.158748:0:17846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9767fb2fe000 10000000:01000000:2.0:1789062046.158760:0:17846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789062046.158764:0:17846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9767fb2fe000 from 1 10000000:01000000:2.0:1789062046.158766:0:17846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789062046.158781:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cfe00/0x2774d8f311dc7972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.158788:0:17846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c80cfe00/0x2774d8f311dc7972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.158794:0:17846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c80cfe00/0x2774d8f311dc7972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062046.158805:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789062046.158832:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062046.158846:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5a5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789062046.158909:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130899584 00000100:00100000:0.0:1789062046.158914:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130899584 00000100:00100000:0.0:1789062046.158931:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789062046.158936:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+13:17846:x1875967130899584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789062046.158944:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062046.158953:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8198600/0x2774d8f311dc7979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7972 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062046.158966:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8198600/0x2774d8f311dc7979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7972 expref: 14 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062046.158973:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8198600/0x2774d8f311dc7979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7972 expref: 14 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062046.158980:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198600, rc 0) 00000100:00100000:0.0:1789062046.159015:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+14:17846:x1875967130899584:12345-0@lo:101:mount.lustre.0 Request processed in 78us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062046.159020:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789062046.159091:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062046.159102:0:17846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c80cfe00/0x2774d8f311dc7972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7979 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.159118:0:17846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c80cfe00/0x2774d8f311dc7972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7979 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062046.159135:0:17846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789062046.159152:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cfe00/0x2774d8f311dc7972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7979 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.159159:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c80cfe00/0x2774d8f311dc7972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7979 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062046.159165:0:17846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789062046.159169:0:17846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789062046.159173:0:17846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9767fb2fe000 10000000:01000000:2.0:1789062046.159176:0:17846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789062046.159179:0:17846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789062046.159181:0:17846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789062046.159196:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cf800/0x2774d8f311dc7980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.159202:0:17846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c80cf800/0x2774d8f311dc7980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.159209:0:17846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c80cf800/0x2774d8f311dc7980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062046.159222:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789062046.159245:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062046.159256:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5a5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789062046.159309:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130899712 00000100:00100000:0.0:1789062046.159314:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130899712 00000100:00100000:0.0:1789062046.159331:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789062046.159337:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+14:17846:x1875967130899712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789062046.159343:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062046.159351:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8199a00/0x2774d8f311dc7987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7980 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062046.159363:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8199a00/0x2774d8f311dc7987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7980 expref: 15 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062046.159371:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8199a00/0x2774d8f311dc7987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7980 expref: 15 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062046.159384:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199a00, rc 0) 00000100:00100000:2.0:1789062046.159648:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062046.159659:0:17846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c80cf800/0x2774d8f311dc7980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7987 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.159673:0:17846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c80cf800/0x2774d8f311dc7980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7987 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062046.161430:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+15:17846:x1875967130899712:12345-0@lo:101:mount.lustre.0 Request processed in 2072us (2163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062046.161441:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000040:00080000:2.0:1789062046.161923:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1789062046.162599:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789062046.167137:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789062046.167194:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789062046.167211:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789062046.167226:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789062046.167238:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789062046.167249:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789062046.167261:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789062046.167275:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789062046.167288:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789062046.167306:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789062046.167318:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789062046.167330:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789062046.167344:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789062046.167357:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789062046.167371:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789062046.167383:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789062046.167396:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789062046.167407:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789062046.169760:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789062046.169786:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789062046.169799:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789062046.169812:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789062046.169825:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789062046.169860:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789062046.169866:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789062046.169976:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062046.170039:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062046.170143:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767cdaf16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789062046.172837:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130899840 00000100:00100000:0.0:1789062046.172852:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130899840 00000100:00100000:0.0:1789062046.173284:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789062046.173296:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+15:17846:x1875967130899840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789062046.173508:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+15:17846:x1875967130899840:12345-0@lo:501:mount.lustre.0 Request processed in 214us (3468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062046.173516:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789062046.173602:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789062046.173681:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899968:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789062046.173735:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062046.174080:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789062046.174231:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130899968 00000100:00100000:3.0:1789062046.174237:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130899968 00000100:00100000:3.0:1789062046.174265:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789062046.174273:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+15:17846:x1875967130899968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789062046.175289:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+15:17846:x1875967130899968:12345-0@lo:503:mount.lustre.0 Request processed in 1014us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062046.175298:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789062046.182354:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130899968:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789062046.183233:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789062046.183469:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130900096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789062046.183541:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062046.183588:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767cdaf1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789062046.183664:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130900096 00000100:00100000:0.0:1789062046.183671:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130900096 00000100:00100000:0.0:1789062046.183718:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789062046.183726:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+15:17846:x1875967130900096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789062046.184310:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+15:17846:x1875967130900096:12345-0@lo:502:mount.lustre.0 Request processed in 584us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062046.184320:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789062046.184522:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130900096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789062046.184885:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789062046.184913:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1789062046.184926:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1789062046.184939:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1789062046.184952:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1789062046.184964:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1789062046.184976:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1789062046.184998:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1789062046.185011:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1789062046.185022:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1789062046.185034:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1789062046.185047:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1789062046.185059:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1789062046.185074:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1789062046.185087:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1789062046.185166:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1789062046.185190:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1789062046.185203:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1789062046.185221:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1789062046.185233:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1789062046.185245:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1789062046.185257:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1789062046.185269:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1789062046.185283:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1789062046.185295:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1789062046.185307:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1789062046.185320:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1789062046.185333:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1789062046.185346:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1789062046.185359:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1789062046.185371:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1789062046.185382:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1789062046.185394:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1789062046.185406:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1789062046.185417:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1789062046.185429:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000100:00100000:2.0:1789062046.185771:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00000040:00080000:3.0:1789062046.185822:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1789062046.185842:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1789062046.185855:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1789062046.185867:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1789062046.185890:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1789062046.185902:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1789062046.185913:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1789062046.185926:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1789062046.185958:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130900224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789062046.186014:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062046.186051:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c2d3ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789062046.186572:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130900224 00000100:00100000:2.0:1789062046.186583:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130900224 00000100:00100000:2.0:1789062046.186679:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789062046.186689:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+15:17846:x1875967130900224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062046.186810:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+15:17846:x1875967130900224:12345-0@lo:502:mount.lustre.0 Request processed in 122us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062046.186817:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789062046.186841:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130900224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789062046.186892:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1789062046.186902:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1789062046.188161:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789062046.188174:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062046.188176:0:17850:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789062046.188182:0:17850:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789062046.188185:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789062046.188199:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9766c645cd40) 00000020:00000080:0.0:1789062046.188222:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1789062046.188228:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789062046.188314:0:17850:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789062046.188321:0:17850:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2774d8f311dc7995 00000020:00000080:0.0:1789062046.188538:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789062046.188542:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789062046.188546:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062046.188548:0:17850:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789062046.188551:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789062046.188554:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062046.188555:0:17850:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789062046.188558:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789062046.188566:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9766c6458000) 00000020:00000080:0.0:1789062046.188576:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1789062046.189114:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789062046.189117:0:17850:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789062046.189120:0:17850:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789062046.189131:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789062046.189186:0:17850:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767fb2fe000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789062046.189200:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9766c64599c0) 00000020:00000080:0.0:1789062046.189210:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789062046.189260:0:17850:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789062046.189265:0:17850:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc79aa 00000020:00000080:0.0:1789062046.189361:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789062046.189367:0:17850:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789062046.189371:0:17850:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2774d8f311dc79b1 00080000:01000000:0.0:1789062046.189378:0:17850:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789062046.189381:0:17850:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2774d8f311dc79b8 00010000:00010000:2.0:1789062046.279961:0:17850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789062046.280626:0:17850:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789062046.281120:0:17850:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789062046.282195:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789062046.282209:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789062046.282215:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062046.282217:0:17850:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789062046.282221:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789062046.282226:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062046.282227:0:17850:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789062046.282231:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789062046.282235:0:17850:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:2.0:1789062046.282261:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789062046.282275:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9767f38a99c0) 00000020:00000080:2.0:1789062046.282294:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789062046.282305:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789062046.282377:0:17850:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789062046.282384:0:17850:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789062046.282391:0:17850:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2774d8f311dc79c6 00010000:00080000:2.0:1789062046.282421:0:17850:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767fd659800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1789062046.289180:0:17850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789062046.293587:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789062046.293602:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789062046.293658:0:17850:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789062046.293677:0:17850:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc79cd 00000100:00080000:0.0:1789062046.293687:0:17850:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789062046.293698:0:17850:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9767fd659800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1789062046.293854:0:17850:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c81aad80 x1875967130900352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789062046.293891:0:17850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789062046.293953:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789062046.293957:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062046.293959:0:17850:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789062046.293962:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789062046.293965:0:17850:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789062046.293966:0:17850:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789062046.293968:0:17850:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789062046.293969:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789062046.293971:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062046.293973:0:17850:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789062046.293975:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789062046.293979:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062046.293980:0:17850:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789062046.293984:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789062046.294114:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130900352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789062046.294180:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789062046.294308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789062046.294313:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789062046.294315:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767fff32000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789062046.294319:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1789062046.294324:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789062046.294330:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9767fff32000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062046.294357:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c8170a80 x1875967130900480/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789062046.294378:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062046.294388:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062046.294391:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062046.294393:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789062046.294430:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130900608:0@lo:400:kworker.0 00000100:00100000:1.0:1789062046.294461:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062046.294507:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130900608 00000100:00100000:1.0:1789062046.294513:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130900608 00000100:00100000:1.0:1789062046.294551:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789062046.294560:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130900608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062046.294625:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130900608:12345-0@lo:400:kworker.0 Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062046.294632:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789062046.294668:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9766c8171f80 x1875967130900608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062046.294681:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130900608:0@lo:400:kworker.0 00000100:00100000:2.0:1789062046.294874:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130900480:0@lo:38:kworker.0 00000100:00100000:2.0:1789062046.294902:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062046.295020:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130900352 00000100:00100000:2.0:1789062046.295025:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130900352 00000100:00100000:2.0:1789062046.295040:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130900480 00000100:00100000:2.0:1789062046.295042:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130900480 00000100:00100000:2.0:1789062046.295051:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789062046.295056:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875967130900352:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789062046.295074:0:17121:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:2.0:1789062046.295103:0:17121:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc79d4 00000004:00100000:2.0:1789062046.295126:0:17121:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789062046.295131:0:17121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000004:01000000:0.0:1789062046.295307:0:17850:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789062046.295338:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789062046.295343:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062046.295344:0:17850:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789062046.295348:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789062046.295350:0:17850:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1789062046.295351:0:17850:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789062046.295353:0:17850:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789062046.295355:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789062046.295357:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062046.295359:0:17850:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789062046.295361:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789062046.295366:0:17850:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789062046.295369:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062046.295370:0:17850:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789062046.295374:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789062046.295377:0:17850:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:0.0:1789062046.295404:0:17850:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789062046.295407:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789062046.295421:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9766c645b380) 00000020:00000080:0.0:1789062046.295436:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789062046.295442:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789062046.295852:0:17850:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789062046.295861:0:17850:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789062046.295868:0:17850:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2774d8f311dc79e2 00010000:00080000:0.0:1789062046.295898:0:17850:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767c3160000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1789062046.296219:0:17850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1789062046.299897:0:17850:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789062046.300284:0:17850:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789062046.306268:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789062046.306695:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789062046.306845:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1789062046.307318:0:17855:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789062046.307323:0:17855:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789062046.308399:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789062046.308411:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789062046.308598:0:17850:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789062046.308654:0:17850:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc79e9 00000100:00080000:3.0:1789062046.308664:0:17850:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789062046.308675:0:17850:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9767c3160000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1789062046.308864:0:17850:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c83e2680 x1875967130900736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789062046.308893:0:17850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789062046.308961:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130900736:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789062046.309039:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875967130900736 offset 0 length 520: 4 00000020:01000000:3.0:1789062046.309210:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789062046.309214:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789062046.309216:0:17850:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789062046.309219:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789062046.309222:0:17850:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1789062046.309224:0:17850:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789062046.309225:0:17850:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789062046.309227:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789062046.309235:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789062046.309236:0:17850:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789062046.309240:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789062046.309244:0:17850:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789062046.309247:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789062046.309249:0:17850:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789062046.309251:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789062046.309255:0:17850:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:3.0:1789062046.309275:0:17850:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789062046.309277:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789062046.309288:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9766c71e4d40) 00000020:00000080:3.0:1789062046.309300:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789062046.309305:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789062046.309369:0:17850:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789062046.309377:0:17850:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789062046.309383:0:17850:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2774d8f311dc79f7 00010000:00080000:3.0:1789062046.309415:0:17850:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9767c3f78000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1789062046.309847:0:17850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789062046.309909:0:17850:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789062046.309923:0:17850:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1789062046.311333:0:17121:0:(import.c:65:import_set_state_nolock()) ffff9767c3f7f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789062046.311978:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1875967130900352:12345-0@lo:38:llog_process_th.0 Request processed in 16918us (17794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062046.311989:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789062046.312028:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789062046.312034:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875967130900480:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789062046.312077:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875967130900480:12345-0@lo:38:kworker.0 Request processed in 42us (17175us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789062046.312084:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1789062046.312866:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789062046.315072:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789062046.315253:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00080000:1.0:1789062046.315813:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062046.315819:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062046.315821:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062046.315824:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789062046.316171:0:17857:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789062046.316176:0:17857:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789062046.317075:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789062046.317087:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789062046.317136:0:17850:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789062046.317162:0:17850:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc79fe 00000100:00080000:2.0:1789062046.317172:0:17850:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789062046.317182:0:17850:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9767c3f78000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062046.317216:0:17850:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c748f800 x1875967130900864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789062046.317232:0:17850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789062046.317347:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789062046.317351:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062046.317352:0:17850:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789062046.317355:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789062046.317358:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062046.317359:0:17850:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789062046.317362:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789062046.317364:0:17850:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789062046.317366:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789062046.317368:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062046.317369:0:17850:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789062046.317371:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789062046.317373:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062046.317374:0:17850:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789062046.317377:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789062046.317399:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789062046.317402:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062046.317404:0:17850:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789062046.317406:0:17850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1789062046.317761:0:17846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789062046.317796:0:17846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789062046.317813:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cf800/0x2774d8f311dc7980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7987 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.317824:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c80cf800/0x2774d8f311dc7980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7987 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789062046.317832:0:17846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767fb2fe000 from 1 10000000:01000000:3.0:1789062046.317835:0:17846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789062046.317859:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.317868:0:17846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.317879:0:17846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062046.317897:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130900992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789062046.317958:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062046.317991:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d0192900 going to sleep for 11 seconds 00000100:00100000:0.0:1789062046.318259:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789062046.318269:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789062046.318276:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789062046.318281:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789062046.318289:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fd659800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789062046.318312:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130900352:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789062046.318333:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130900864:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789062046.318357:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875967130900864 offset 0 length 520: 4 00000100:00100000:0.0:1789062046.318383:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789062046.318388:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fff32000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789062046.318398:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789062046.318401:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130900480:0@lo:38:kworker.0 00000100:00100000:0.0:1789062046.318681:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130900992 00000100:00100000:0.0:1789062046.318688:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130900992 00000100:00100000:0.0:1789062046.318739:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789062046.318747:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+15:17846:x1875967130900992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789062046.318761:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062046.318774:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7a0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7a05 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062046.318798:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7a05 expref: 16 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062046.318808:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a05 expref: 16 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062046.318815:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199000, rc 0) 00000100:00100000:0.0:1789062046.318850:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+16:17846:x1875967130900992:12345-0@lo:101:mount.lustre.0 Request processed in 104us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062046.318857:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789062046.319269:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130900992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789062046.319284:0:17846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a0c expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.319293:0:17846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7a0c expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062046.319734:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789062046.319745:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130901120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789062046.319781:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062046.320300:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130901248:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789062046.320342:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062046.320374:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d0192900 going to sleep for 11 seconds 00000100:00100000:3.0:1789062046.320778:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130901120 00000100:00100000:3.0:1789062046.320785:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130901120 00000100:00100000:3.0:1789062046.320825:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789062046.320833:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1875967130901120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789062046.320862:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789062046.320911:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1875967130901120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062046.320918:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789062046.320965:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130901120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789062046.321034:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130901248 00000100:00100000:2.0:1789062046.321038:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130901248 00000100:00100000:2.0:1789062046.321071:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789062046.321078:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+16:17846:x1875967130901248:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789062046.321098:0:17109:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789062046.321123:0:17109:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789062046.321126:0:17109:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789062046.321200:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+16:17846:x1875967130901248:12345-0@lo:256:mount.lustre.0 Request processed in 122us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062046.321207:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789062046.322169:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130901248:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789062046.323167:0:17846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789062046.323229:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a0c expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.323243:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a0c expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789062046.323253:0:17846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fb2fe000 from 1 10000000:01000000:3.0:1789062046.323256:0:17846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789062046.323289:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.323298:0:17846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.323308:0:17846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062046.323336:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130901376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789062046.323387:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062046.323446:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d0192900 going to sleep for 11 seconds 00000100:00080000:1.0:1789062046.323539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062046.323544:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062046.323547:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062046.323556:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789062046.324047:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130901376 00000100:00100000:2.0:1789062046.324054:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130901376 00000100:00100000:2.0:1789062046.324102:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789062046.324120:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+16:17846:x1875967130901376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062046.324132:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062046.324145:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c80ce600/0x2774d8f311dc7a1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7a13 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.324168:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c80ce600/0x2774d8f311dc7a1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7a13 expref: 17 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.324179:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c80ce600/0x2774d8f311dc7a1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a13 expref: 17 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.324189:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce600, rc 0) 00000100:00100000:2.0:1789062046.324239:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17846:x1875967130901376:12345-0@lo:101:mount.lustre.0 Request processed in 121us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062046.324246:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789062046.324429:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130901376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789062046.324450:0:17846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a1a expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.324461:0:17846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7a1a expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789062046.325017:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789062046.325057:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130901504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789062046.325096:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062046.325136:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789062046.325693:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130901504 00000100:00100000:3.0:1789062046.325709:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130901504 00000100:00100000:3.0:1789062046.325748:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789062046.325755:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17846:x1875967130901504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062046.325857:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17846:x1875967130901504:12345-0@lo:501:mount.lustre.0 Request processed in 102us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062046.325864:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789062046.328044:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130901504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789062046.328114:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130901632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789062046.328183:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062046.328226:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789062046.328351:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130901632 00000100:00100000:3.0:1789062046.328358:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130901632 00000100:00100000:3.0:1789062046.328410:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789062046.328426:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17846:x1875967130901632:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789062046.328551:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17846:x1875967130901632:12345-0@lo:503:mount.lustre.0 Request processed in 133us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062046.328558:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789062046.328656:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130901632:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789062046.329132:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789062046.329201:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130901760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062046.329249:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062046.329269:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767f7e43240 going to sleep for 11 seconds 00000100:00100000:3.0:1789062046.329341:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130901760 00000100:00100000:3.0:1789062046.329345:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130901760 00000100:00100000:3.0:1789062046.329370:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789062046.329376:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17846:x1875967130901760:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789062046.329447:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17846:x1875967130901760:12345-0@lo:502:mount.lustre.0 Request processed in 70us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062046.329454:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789062046.329496:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130901760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789062046.329685:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789062046.329827:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1789062046.329845:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1789062046.329858:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1789062046.329871:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1789062046.329884:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1789062046.329897:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1789062046.329908:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1789062046.329920:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789062046.329933:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1789062046.329945:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1789062046.329966:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130901888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789062046.330405:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062046.330441:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d0192c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789062046.330645:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130901888 00000100:00100000:1.0:1789062046.330651:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130901888 00000100:00100000:1.0:1789062046.330685:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789062046.330693:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17846:x1875967130901888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789062046.330811:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17846:x1875967130901888:12345-0@lo:502:mount.lustre.0 Request processed in 119us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062046.330818:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789062046.332203:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130901888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789062046.332287:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1789062046.332308:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789062046.333149:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062046.333159:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062046.333162:0:17859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789062046.333168:0:17859:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767fb2fe000 00000020:00000080:1.0:1789062046.333171:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789062046.333179:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062046.333181:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062046.333182:0:17859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789062046.333184:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062046.333187:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062046.333188:0:17859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789062046.333191:0:17859:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767fb2fe000 00000020:00000080:1.0:1789062046.333193:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789062046.333280:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062046.333284:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062046.333286:0:17859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789062046.333289:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062046.333292:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062046.333293:0:17859:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789062046.333297:0:17859:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767fb2fe000 00000020:00000080:1.0:1789062046.333299:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789062046.337545:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062046.337558:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062046.337560:0:17859:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789062046.337565:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062046.337569:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062046.337571:0:17859:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789062046.337576:0:17859:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767fb2fe000 00000020:00000080:1.0:1789062046.337578:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789062046.337658:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062046.337662:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062046.337663:0:17859:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789062046.337667:0:17859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1789062046.337867:0:17846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789062046.337896:0:17846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789062046.337924:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a1a expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.337936:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a1a expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062046.337987:0:17846:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789062046.337991:0:17846:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9767fb2fe000 10000000:01000000:2.0:1789062046.337994:0:17846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9767fb2fe000 10000000:01000000:2.0:1789062046.337998:0:17846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789062046.338003:0:17846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767fb2fe000 from 1 10000000:01000000:2.0:1789062046.338006:0:17846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789062046.338039:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cee00/0x2774d8f311dc7a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.338047:0:17846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c80cee00/0x2774d8f311dc7a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062046.338058:0:17846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c80cee00/0x2774d8f311dc7a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062046.338082:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789062046.338153:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062046.338189:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767f7e43900 going to sleep for 11 seconds 00000100:00100000:1.0:1789062046.342357:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130902016 00000100:00100000:1.0:1789062046.342372:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130902016 00000100:00100000:1.0:1789062046.342443:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789062046.342455:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17846:x1875967130902016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789062046.342471:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789062046.342489:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47ac00/0x2774d8f311dc7a28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7a21 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.342517:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47ac00/0x2774d8f311dc7a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7a21 expref: 18 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.342528:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47ac00/0x2774d8f311dc7a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a21 expref: 18 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.342536:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47ac00, rc 0) 00000100:00100000:1.0:1789062046.342627:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17846:x1875967130902016:12345-0@lo:101:mount.lustre.0 Request processed in 175us (4474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062046.342634:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789062046.342697:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789062046.342714:0:17846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c80cee00/0x2774d8f311dc7a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a28 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.342724:0:17846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c80cee00/0x2774d8f311dc7a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7a28 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789062046.358947:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789062046.359238:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789062046.359414:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789062046.359453:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1789062046.359466:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1789062046.359477:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1789062046.359503:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1789062046.359517:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1789062046.359528:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1789062046.359538:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1789062046.359553:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1789062046.359566:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1789062046.359580:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1789062046.359593:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1789062046.359625:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1789062046.359642:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1789062046.359655:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1789062046.359668:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1789062046.359681:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1789062046.359694:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1789062046.359707:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1789062046.359721:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1789062046.359734:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1789062046.359748:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1789062046.359761:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1789062046.359774:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1789062046.359788:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1789062046.359801:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1789062046.359815:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1789062046.359829:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1789062046.359848:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1789062046.359853:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789062046.359930:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062046.359997:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062046.360049:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130902144 00000100:00100000:2.0:1789062046.360056:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130902144 00000100:00100000:2.0:1789062046.360098:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789062046.360118:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17846:x1875967130902144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062046.360219:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17846:x1875967130902144:12345-0@lo:501:mount.lustre.0 Request processed in 112us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062046.360227:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789062046.360266:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767f7e43840 going to sleep for 11 seconds 00000100:00100000:2.0:1789062046.360286:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062046.360313:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789062046.360351:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062046.360373:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130902272 00000100:00100000:2.0:1789062046.360377:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130902272 00000100:00100000:2.0:1789062046.360397:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789062046.360403:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17846:x1875967130902272:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789062046.360466:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17846:x1875967130902272:12345-0@lo:503:mount.lustre.0 Request processed in 62us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062046.360472:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789062046.360506:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767f7e43840 going to sleep for 11 seconds 00000100:00100000:2.0:1789062046.360518:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902272:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789062046.360840:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789062046.360891:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062046.360928:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062046.360952:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130902400 00000100:00100000:2.0:1789062046.360956:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130902400 00000100:00100000:2.0:1789062046.360977:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789062046.360990:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17846:x1875967130902400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062046.361057:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17846:x1875967130902400:12345-0@lo:502:mount.lustre.0 Request processed in 68us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062046.361064:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789062046.361095:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767f7e43840 going to sleep for 11 seconds 00000100:00100000:2.0:1789062046.361120:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789062046.361256:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789062046.361278:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1789062046.361292:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1789062046.361307:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1789062046.361319:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1789062046.361332:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1789062046.361344:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1789062046.361357:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1789062046.361369:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1789062046.361382:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1789062046.361393:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1789062046.361405:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1789062046.361418:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1789062046.361431:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1789062046.361444:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1789062046.361456:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1789062046.361468:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1789062046.361480:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1789062046.361495:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1789062046.361508:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1789062046.361520:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1789062046.361532:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1789062046.361545:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1789062046.361560:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1789062046.361584:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1789062046.361597:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1789062046.361637:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1789062046.361655:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1789062046.361669:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1789062046.361683:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1789062046.361696:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1789062046.361709:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1789062046.361722:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1789062046.361734:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1789062046.361746:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1789062046.361760:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1789062046.361774:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1789062046.361787:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1789062046.361800:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1789062046.361814:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1789062046.361827:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1789062046.361841:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1789062046.361855:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1789062046.361869:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1789062046.361883:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1789062046.361897:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1789062046.361910:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1789062046.361923:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1789062046.361955:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062046.361997:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062046.362024:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130902528 00000100:00100000:2.0:1789062046.362029:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130902528 00000100:00100000:2.0:1789062046.362054:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789062046.362061:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17846:x1875967130902528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789062046.365687:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767f7e43840 going to sleep for 11 seconds 00000100:00100000:2.0:1789062046.368239:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17846:x1875967130902528:12345-0@lo:502:mount.lustre.0 Request processed in 6169us (6233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062046.368259:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789062046.368335:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789062046.371267:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1789062046.371315:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1789062046.371359:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062046.371425:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062046.371477:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130902656 00000100:00100000:2.0:1789062046.371484:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130902656 00000100:00100000:2.0:1789062046.371525:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789062046.371535:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17846:x1875967130902656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062046.371648:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17846:x1875967130902656:12345-0@lo:502:mount.lustre.0 Request processed in 114us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062046.371655:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789062046.371717:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767f7e43840 going to sleep for 11 seconds 00000100:00100000:2.0:1789062046.371737:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789062046.371776:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1789062046.371784:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789062046.372862:0:17864:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789062046.372878:0:17864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9767fa378000) 00000020:00000080:0.0:1789062046.372897:0:17864:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789062046.372980:0:17864:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767fb2fe000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789062046.372984:0:17864:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767fb2fe000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789062046.372987:0:17864:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fb2fe000 3 00010000:00080000:0.0:1789062046.373013:0:17864:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9766c572c000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1789062046.379760:0:17864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789062046.379967:0:17864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789062046.381637:0:17864:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789062046.381654:0:17864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2774d8f311dc7a36 00000100:00080000:0.0:1789062046.381663:0:17864:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789062046.381675:0:17864:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9766c572c000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1789062046.381710:0:17864:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c81aad80 x1875967130902784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789062046.381748:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875967130902784:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789062046.381808:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062046.381864:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130902784 00000100:00100000:0.0:1789062046.381870:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130902784 00000100:00100000:0.0:1789062046.381899:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789062046.381907:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875967130902784:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789062046.381928:0:17117:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:0.0:1789062046.381957:0:17117:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2774d8f311dc7a3d 00000004:00100000:0.0:1789062046.381969:0:17117:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789062046.381992:0:17117:0:(import.c:65:import_set_state_nolock()) ffff9766c572d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789062046.382037:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875967130902784:12345-0@lo:38:llog_process_th.0 Request processed in 128us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062046.382044:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789062046.382080:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9766c81aad80 x1875967130902784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789062056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062046.382090:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789062046.382097:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789062046.382338:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789062046.382345:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789062046.382348:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9766c572c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789062046.382363:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875967130902784:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789062046.382383:0:17864:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1789062046.383185:0:17864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00080000:1.0:1789062046.385745:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062046.385752:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062046.385762:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062046.385765:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1789062046.385787:0:17846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789062046.385819:0:17846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789062046.385843:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cee00/0x2774d8f311dc7a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a28 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.385857:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c80cee00/0x2774d8f311dc7a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a28 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789062046.385904:0:17846:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789062046.385906:0:17846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789062046.385908:0:17846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789062046.385909:0:17846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789062046.385910:0:17846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789062046.385912:0:17846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789062046.385913:0:17846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789062046.385914:0:17846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789062046.385916:0:17846:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789062046.385919:0:17846:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789062046.385922:0:17846:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789062046.385923:0:17846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789062046.385924:0:17846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789062046.385926:0:17846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789062046.385926:0:17846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789062046.385928:0:17846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789062046.385928:0:17846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789062046.385930:0:17846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789062046.385931:0:17846:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789062046.385955:0:17846:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789062046.385973:0:17846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902912:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789062046.386036:0:17846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062046.386126:0:17846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d696c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789062046.386886:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130902912 00000100:00100000:2.0:1789062046.386894:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130902912 00000100:00100000:2.0:1789062046.386940:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789062046.386949:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17846:x1875967130902912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789062046.386975:0:17108:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789062046.386986:0:17108:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789062046.390238:0:17095:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789062046.390350:0:17108:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789062046.390367:0:17108:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789062046.390541:0:17131:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789062046.390546:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789062046.390568:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.390587:0:17131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc7948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7941 expref: 18 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.390595:0:17131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a05 expref: 18 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.390623:0:17131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.390660:0:17131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7a05 expref: 18 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.390674:0:17131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7a0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7a05 expref: 18 pid: 17110 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062046.390688:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8173b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130903040:0@lo:104: 00000100:00100000:1.0:1789062046.390744:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789062046.390786:0:17131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc7948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7941 expref: 18 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.390796:0:17131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc7948 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7941 expref: 18 pid: 17108 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062046.390804:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130903168:0@lo:104: 00000100:00100000:1.0:1789062046.390822:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062046.390839:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c75c9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789062046.390879:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130903040 00000100:00100000:1.0:1789062046.390886:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130903040 00000100:00100000:1.0:1789062046.390914:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130903168 00000100:00100000:1.0:1789062046.390916:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130903168 00000100:00100000:1.0:1789062046.390928:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789062046.390936:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+4:17131:x1875967130903040:12345-0@lo:104: 00010000:00010000:1.0:1789062046.390948:0:17099:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7a0c expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.390992:0:17099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789062046.390998:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+4:17131:x1875967130903040:12345-0@lo:104: Request processed in 63us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062046.391005:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789062046.391021:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789062046.391027:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+3:17131:x1875967130903168:12345-0@lo:104: 00010000:00010000:1.0:1789062046.391034:0:17099:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7948 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.391069:0:17099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789062046.391073:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+3:17131:x1875967130903168:12345-0@lo:104: Request processed in 47us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062046.391079:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789062046.391093:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789062046.391099:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7a0c expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.391119:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a200 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789062046.391123:0:17104:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7a0c expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.391142:0:17104:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7a0c expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789062046.391149:0:17104:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7a0c expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789062046.391155:0:17104:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789062046.391177:0:17104:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a0c expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.391183:0:17104:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789062046.391198:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a0c expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.391205:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c807a200/0x2774d8f311dc7a05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a0c expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.391217:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789062046.391220:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7948 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.391226:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce200 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789062046.391229:0:17104:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7948 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.391235:0:17104:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7948 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789062046.391242:0:17104:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7948 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789062046.391253:0:17104:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789062046.391265:0:17104:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7948 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.391270:0:17104:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789062046.391284:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7948 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.391290:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c80ce200/0x2774d8f311dc7941 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7948 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062046.391303:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062046.391305:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062046.391306:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062046.391312:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062046.391322:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83f5b9c6-643c-4659-afe5-bacf144ade05:3620:1875967130903424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789062046.391349:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062046.391406:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8173b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130903040:0@lo:104: 00000100:00100000:1.0:1789062046.391414:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130903168:0@lo:104: 00010000:00010000:1.0:1789062046.391431:0:17131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062046.391534:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130903296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789062046.391561:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062046.391599:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130903424 00000100:00100000:3.0:1789062046.391625:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130903424 00010000:00010000:3.0:1789062046.391642:0:17101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc7948 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7941 expref: 19 pid: 17108 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062046.391659:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130903296 00000100:00100000:3.0:1789062046.391663:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130903296 00010000:00010000:3.0:1789062046.391672:0:17101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7a0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7a05 expref: 20 pid: 17110 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062046.391682:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789062046.391687:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+20:3620:x1875967130903424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789062046.391703:0:17101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789062046.391708:0:17101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc7948 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7941 expref: 20 pid: 17108 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391718:0:17101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc7948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7941 expref: 20 pid: 17108 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391730:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47b200/0x2774d8f311dc7948 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7941 expref: 20 pid: 17108 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391740:0:17101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062046.391771:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+19:3620:x1875967130903424:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062046.391777:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789062046.391790:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789062046.391796:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+18:3623:x1875967130903296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789062046.391803:0:17101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789062046.391808:0:17101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7a0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7a05 expref: 18 pid: 17110 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391816:0:17101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7a05 expref: 18 pid: 17110 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391825:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7a0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7a05 expref: 18 pid: 17110 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391836:0:17101:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391843:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789062046.391861:0:17101:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004973278s 00010000:00010000:3.0:1789062046.391866:0:17101:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391874:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391880:0:17101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391886:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391891:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789062046.391895:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391901:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391915:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.391923:0:17101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062046.391948:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+17:3623:x1875967130903296:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062046.391953:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789062046.391978:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130903296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789062046.392026:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+16:17846:x1875967130902912:12345-0@lo:253:mount.lustre.0 Request processed in 5077us (5990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062046.392039:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1789062046.392069:0:17131:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.392077:0:17131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062046.392084:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47b800/0x2774d8f311dc7a44 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062046.392121:0:17846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:17846:1875967130902912:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789062046.392131:0:17846:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789062046.392134:0:17846:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789062046.392135:0:17846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789062046.392137:0:17846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789062046.392138:0:17846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789062046.392139:0:17846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789062046.392140:0:17846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789062046.392141:0:17846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789062046.392144:0:17846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789062046.392145:0:17846:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789062046.392155:0:17846:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789062046.397208:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83f5b9c6-643c-4659-afe5-bacf144ade05:3620:1875967130903424:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1789062046.418313:0:17846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789062046.418380:0:17870:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789062046.418383:0:17870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789062046.418586:0:17871:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789062046.418792:0:17846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789062046.419288:0:17872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17872:1875967130903552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789062046.419365:0:17872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062046.419403:0:17872:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789062046.419451:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130903552 00000100:00100000:0.0:1789062046.419460:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130903552 00000100:00100000:0.0:1789062046.419516:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789062046.419526:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17872:x1875967130903552:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789062046.419644:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17872:x1875967130903552:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062046.419652:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789062046.419700:0:17872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17872:1875967130903552:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789062046.419727:0:17872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789062046.419752:0:17872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81aad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17872:1875967130903680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789062046.419783:0:17872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062046.419802:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130903680 00000100:00100000:0.0:1789062046.419805:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130903680 00000100:00100000:0.0:1789062046.419824:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789062046.419830:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17872:x1875967130903680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789062046.419911:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17872:x1875967130903680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 81us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062046.419917:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789062046.419932:0:17872:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d691ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789062046.419944:0:17872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81aad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17872:1875967130903680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789062046.419993:0:17872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81aad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17872:1875967130903808:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789062046.420027:0:17872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062046.420040:0:17872:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e000 going to sleep for 11 seconds 00000040:01000000:2.0:1789062046.420259:0:17846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789062046.420301:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789062046.420759:0:17846:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789062046.420766:0:17846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789062046.420802:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789062046.421812:0:17846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789062046.422377:0:17846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789062046.422408:0:17846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789062046.422568:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789062046.423056:0:17846:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1789062046.425393:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130903808 00000100:00100000:1.0:1789062046.425407:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130903808 00000100:00100000:1.0:1789062046.425465:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789062046.425485:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17872:x1875967130903808:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789062046.425576:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17872:x1875967130903808:12345-0@lo:900:lod0001_rec0000.0 Request processed in 101us (5547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062046.425584:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789062046.425750:0:17872:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9766c81aad80 x1875967130903808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789062062 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062046.425765:0:17872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81aad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17872:1875967130903808:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789062046.425837:0:17872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81aad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17872:1875967130903936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789062046.425876:0:17872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062046.425908:0:17872:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49ecc0 going to sleep for 11 seconds 00000040:00080000:3.0:1789062046.426040:0:17871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789062046.428228:0:17871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789062046.428310:0:17871:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1789062046.429033:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130903936 00000100:00100000:1.0:1789062046.429042:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130903936 00000100:00100000:1.0:1789062046.429089:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789062046.429098:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17872:x1875967130903936:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789062046.429227:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17872:x1875967130903936:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 130us (3350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062046.429235:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789062046.429317:0:17872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81aad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17872:1875967130903936:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1789062046.429366:0:17872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789062046.431531:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789062046.431634:0:17872:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789062046.431639:0:17872:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1789062046.435443:0:17846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789062046.437536:0:17846:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789062046.437570:0:17846:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbc88416b3988 00100000:10000000:2.0:1789062046.437578:0:17846:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789062046.438639:0:17846:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789062046.438669:0:17846:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789062046.438686:0:17846:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789062046.438713:0:17846:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789062046.439977:0:17846:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789062046.440280:0:17846:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789062046.766870:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062047.214430:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00000040:00080000:0.0:1789062047.470848:0:17867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789062047.723315:0:17112:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789062047.723322:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767fb2fe000 from 8 10000000:01000000:0.0:1789062047.723327:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789062047.723369:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062047.723382:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062047.723393:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062047.723417:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130904064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789062047.723489:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062047.723543:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789062047.723744:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130904064 00000100:00100000:2.0:1789062047.723752:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130904064 00000100:00100000:2.0:1789062047.723805:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789062047.723813:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+16:17112:x1875967130904064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789062047.723826:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062047.723840:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c80cec00/0x2774d8f311dc7a52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7a4b expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062047.723863:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c80cec00/0x2774d8f311dc7a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7a4b expref: 17 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062047.723874:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c80cec00/0x2774d8f311dc7a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a4b expref: 17 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062047.723894:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cec00, rc 0) 00000100:00100000:2.0:1789062047.723933:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17112:x1875967130904064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062047.723940:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789062047.725168:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130904064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789062047.725191:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a52 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062047.725200:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7a52 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062047.725262:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130904192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789062047.725312:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062047.725366:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789062047.730517:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130904192 00000100:00100000:2.0:1789062047.730530:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130904192 00000100:00100000:2.0:1789062047.730600:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789062047.730633:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17112:x1875967130904192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789062047.730657:0:17108:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789062047.730673:0:17108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789062047.730676:0:17108:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789062047.730810:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17112:x1875967130904192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 180us (5496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062047.730817:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789062047.730867:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130904192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789062047.730921:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789062047.730929:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a52 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062047.730941:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a52 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062047.730951:0:17112:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789062047.730954:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767f7e7a800 from 8 10000000:01000000:2.0:1789062047.730957:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789062047.730986:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062047.730999:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062047.731008:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062047.731028:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130904320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789062047.731059:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062047.731087:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789062047.731112:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130904320 00000100:00100000:2.0:1789062047.731116:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130904320 00000100:00100000:2.0:1789062047.731139:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789062047.731145:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17112:x1875967130904320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789062047.731154:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062047.731166:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c80ce200/0x2774d8f311dc7a60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7a59 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062047.731184:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c80ce200/0x2774d8f311dc7a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7a59 expref: 18 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062047.731193:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c80ce200/0x2774d8f311dc7a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a59 expref: 18 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062047.731200:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce200, rc 0) 00000100:00100000:2.0:1789062047.731227:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17112:x1875967130904320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062047.731232:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789062047.731268:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130904320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789062047.731279:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a60 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062047.731287:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7a60 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062047.731325:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130904448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789062047.731351:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062047.731364:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789062047.731375:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130904448 00000100:00100000:2.0:1789062047.731379:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130904448 00000100:00100000:2.0:1789062047.731394:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789062047.731400:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17112:x1875967130904448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789062047.731409:0:17110:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789062047.731418:0:17110:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789062047.731421:0:17110:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789062047.731474:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17112:x1875967130904448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 73us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062047.731481:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789062047.731510:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130904448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789062047.731538:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789062047.731543:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a60 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062047.731551:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a60 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062047.787149:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789062048.239193:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00000040:00080000:0.0:1789062048.490236:0:17867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789062048.817749:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789062049.259371:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00010000:00010000:3.0:1789062049.834158:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062050.282817:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00010000:00010000:3.0:1789062050.860409:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789062050.913485:0:18115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789062051.306010:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 0 seconds 00000100:00100000:3.0:1789062051.497829:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130904576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789062051.497900:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062051.497983:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130904576 00000100:00100000:3.0:1789062051.497991:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130904576 00000100:00100000:3.0:1789062051.498031:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789062051.498039:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130904576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789062051.498080:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789062051.498126:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130904576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062051.498133:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789062051.498185:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130904576:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789062051.498685:0:15132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789062051.498690:0:15132:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789062051.498693:0:15132:0:(import.c:65:import_set_state_nolock()) ffff9767fff32000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789062051.498703:0:15132:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9767fff32000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062051.498723:0:15132:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c8170e00 x1875967130904832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789062051.498738:0:15132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062051.498742:0:15132:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062051.498744:0:15132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062051.498747:0:15132:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062051.498757:0:15132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062051.498760:0:15132:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062051.498762:0:15132:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062051.498765:0:15132:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789062051.498909:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130904704:0@lo:400:kworker.0 00000100:00100000:1.0:1789062051.498950:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062051.498983:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789062051.498989:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130904960:0@lo:400:kworker.0 00000100:00100000:1.0:1789062051.499014:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062051.499042:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130904960 00000100:00100000:1.0:1789062051.499047:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130904960 00000100:00100000:1.0:1789062051.499089:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789062051.499103:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130904960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062051.499141:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130904960:12345-0@lo:400:kworker.0 Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062051.499148:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789062051.499170:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130905088:0@lo:400:kworker.0 00000100:00100000:1.0:1789062051.499196:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062051.499223:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130905088 00000100:00100000:1.0:1789062051.499227:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130905088 00000100:00100000:1.0:1789062051.499248:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789062051.499254:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130905088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062051.499287:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130905088:12345-0@lo:400:kworker.0 Request processed in 32us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062051.499293:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789062051.499312:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130904832:0@lo:38:kworker.0 00000100:00100000:1.0:1789062051.499336:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789062051.499368:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766c8173b80 x1875967130905088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062051.499379:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130905088:0@lo:400:kworker.0 00010000:00080000:1.0:1789062051.499404:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766c8172a00 x1875967130904960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062051.499413:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130904960:0@lo:400:kworker.0 00000100:00100000:2.0:1789062051.500601:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130904704 00000100:00100000:2.0:1789062051.500677:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130904704 00000100:00100000:2.0:1789062051.500715:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789062051.500724:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:3622:x1875967130904704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062051.500784:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:3622:x1875967130904704:12345-0@lo:400:kworker.0 Request processed in 62us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062051.500791:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789062051.500841:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130904704:0@lo:400:kworker.0 00000100:00100000:3.0:1789062051.501580:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130904832 00000100:00100000:3.0:1789062051.501587:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130904832 00000100:00100000:3.0:1789062051.501637:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789062051.501644:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875967130904832:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789062051.501668:0:17120:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:3.0:1789062051.501701:0:17120:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc7a67 00000004:00100000:3.0:1789062051.501715:0:17120:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789062051.501720:0:17120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789062051.520933:0:17120:0:(import.c:65:import_set_state_nolock()) ffff9767fb31e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789062051.521027:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875967130904832:12345-0@lo:38:kworker.0 Request processed in 19381us (21688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062051.521038:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789062051.521132:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789062051.521143:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789062051.521149:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789062051.521159:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767fff32000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789062051.521182:0:3619:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001d403a79): req@ffff9766c8171180 x1875967130897792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062051.521205:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130904832:0@lo:38:kworker.0 00000100:00100000:3.0:1789062051.521304:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062051.521344:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5b7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789062051.521382:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130897792 00000100:00100000:1.0:1789062051.521388:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130897792 00000100:00100000:1.0:1789062051.521429:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789062051.521439:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17156:x1875967130897792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789062051.521510:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17156:x1875967130897792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062051.521517:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789062051.521652:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17156:1875967130897792:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789062051.521684:0:17156:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789062051.521723:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17156:1875967130905216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789062051.521756:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062051.521779:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789062051.521791:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130905216 00000100:00100000:3.0:1789062051.521795:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130905216 00000100:00100000:3.0:1789062051.521812:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789062051.521825:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17156:x1875967130905216:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789062051.521917:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17156:x1875967130905216:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 92us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062051.521923:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789062051.521947:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17156:1875967130905216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789062051.522002:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17156:1875967130905344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789062051.522025:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062051.522038:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789062051.522048:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130905344 00000100:00100000:3.0:1789062051.522051:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130905344 00000100:00100000:3.0:1789062051.522066:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789062051.522083:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17156:x1875967130905344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789062051.522126:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17156:x1875967130905344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 43us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062051.522132:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789062051.522154:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17156:1875967130905344:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1789062051.522189:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789062051.523623:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789062051.523638:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130905472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789062051.523684:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062051.524703:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130905472 00000100:00100000:2.0:1789062051.524712:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130905472 00000100:00100000:2.0:1789062051.524761:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789062051.524770:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875967130905472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789062051.524800:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789062051.524859:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875967130905472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062051.524866:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789062051.524919:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130905472:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789062051.528418:0:17156:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789062051.530587:0:17156:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1789062051.530599:0:17156:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1789062051.819113:0:18167:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789062051.821452:0:18167:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789062051.882856:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062052.906851:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789062052.961091:0:18217:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789062052.963146:0:18217:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789062053.930930:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789062053.984367:0:18265:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb4f34200 20000000:00000080:3.0:1789062053.984386:0:18265:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9767eb88c800 uarg=0000000000000000 20000000:01000000:3.0:1789062053.984493:0:18265:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789062053.984508:0:18265:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789062053.984513:0:18265:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789062053.985033:0:18266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789062053.985326:0:18265:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789062053.991788:0:18265:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789062053.991821:0:18265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062053.991840:0:18265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c80cf600/0x2774d8f311dc7917 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7910 expref: 17 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062053.991848:0:18265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c80ce600/0x2774d8f311dc7a1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a13 expref: 17 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062053.991856:0:18265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062053.991900:0:18265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c80ce600/0x2774d8f311dc7a1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7a13 expref: 17 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062053.991916:0:18265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766c80ce600/0x2774d8f311dc7a1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7a13 expref: 17 pid: 17108 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062053.991930:0:18265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18265:1875967130905600:0@lo:104: 00000100:00100000:3.0:1789062053.992984:0:18265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789062053.993114:0:18265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c80cf600/0x2774d8f311dc7917 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7910 expref: 17 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062053.993301:0:18265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766c80cf600/0x2774d8f311dc7917 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7910 expref: 17 pid: 17108 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062053.993313:0:18265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18265:1875967130905728:0@lo:104: 00000100:00100000:3.0:1789062053.993358:0:18265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062053.993463:0:18265:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789062053.994559:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130905600 00000100:00100000:1.0:1789062053.994569:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130905600 00000100:00100000:1.0:1789062053.994623:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130905728 00000100:00100000:1.0:1789062053.994627:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130905728 00000100:00100000:1.0:1789062053.994643:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789062053.994652:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+4:18265:x1875967130905600:12345-0@lo:104: 00010000:00010000:1.0:1789062053.994667:0:17099:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7a1a expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.994741:0:17099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789062053.994747:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+4:18265:x1875967130905600:12345-0@lo:104: Request processed in 97us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062053.994755:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789062053.994773:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789062053.994779:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+3:18265:x1875967130905728:12345-0@lo:104: 00010000:00010000:1.0:1789062053.994797:0:17099:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7917 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.994846:0:17099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789062053.994851:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+3:18265:x1875967130905728:12345-0@lo:104: Request processed in 74us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062053.994857:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789062053.994877:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789062053.994882:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7a1a expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.994889:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a400 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789062053.994893:0:17104:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7a1a expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.994902:0:17104:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7a1a expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789062053.994910:0:17104:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7a1a expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789062053.994917:0:17104:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789062053.994952:0:17104:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a1a expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995183:0:17104:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789062053.995211:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a1a expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995219:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c807a400/0x2774d8f311dc7a13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a1a expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995238:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789062053.995242:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7917 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995247:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a800 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789062053.995249:0:17104:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7917 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995256:0:17104:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7917 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789062053.995262:0:17104:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7917 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789062053.995267:0:17104:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789062053.995280:0:17104:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7917 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995285:0:17104:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789062053.995291:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7917 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995297:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7910 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7917 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995310:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062053.995312:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062053.995314:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062053.995320:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062053.995346:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130905984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789062053.995380:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062053.995412:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789062053.995417:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130905856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789062053.995506:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062053.995539:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130905984 00000100:00100000:1.0:1789062053.995544:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130905984 00010000:00010000:1.0:1789062053.995564:0:17101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c80cf600/0x2774d8f311dc7917 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7910 expref: 18 pid: 17108 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062053.995584:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130905856 00000100:00100000:1.0:1789062053.995587:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130905856 00010000:00010000:1.0:1789062053.995597:0:17101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c80ce600/0x2774d8f311dc7a1a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7a13 expref: 19 pid: 17108 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062053.995633:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789062053.995640:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8173b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+19:3623:x1875967130905984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789062053.995650:0:17101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789062053.995655:0:17101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766c80cf600/0x2774d8f311dc7917 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7910 expref: 19 pid: 17108 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995664:0:17101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c80cf600/0x2774d8f311dc7917 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7910 expref: 19 pid: 17108 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995680:0:17101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789062053.995707:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8173b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+19:3623:x1875967130905984:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062053.995714:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789062053.995727:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789062053.995733:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+18:3623:x1875967130905856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789062053.995747:0:17101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789062053.995752:0:17101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766c80ce600/0x2774d8f311dc7a1a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7a13 expref: 18 pid: 17108 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995761:0:17101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c80ce600/0x2774d8f311dc7a1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7a13 expref: 18 pid: 17108 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995773:0:17101:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995782:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995797:0:17101:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995805:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995812:0:17101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995818:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995824:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b000 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789062053.995829:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995836:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995857:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062053.995866:0:17101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789062053.995889:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+18:3623:x1875967130905856:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062053.995895:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789062053.995933:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130905856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789062053.995942:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130905984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789062053.998788:0:18265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c80ce600/0x2774d8f311dc7a1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7a13 expref: 17 pid: 17108 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062053.998819:0:18265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18265:1875967130905600:0@lo:104: 00010000:00010000:0.0:1789062053.998834:0:18265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c80cf600/0x2774d8f311dc7917 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7910 expref: 16 pid: 17108 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062053.998844:0:18265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18265:1875967130905728:0@lo:104: 00010000:00010000:0.0:1789062053.998868:0:18265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062053.998902:0:18265:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062053.998909:0:18265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062053.998916:0:18265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7a6e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789062054.378582:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789062054.955518:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789062055.466687:0:17112:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789062055.466698:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fb2fe000 from 13 10000000:01000000:1.0:1789062055.466706:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789062055.466767:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062055.466782:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062055.466797:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062055.466829:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130906112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789062055.466931:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062055.466991:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c7ceb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789062055.467193:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130906112 00000100:00100000:2.0:1789062055.467204:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130906112 00000100:00100000:2.0:1789062055.467275:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789062055.467286:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+16:17112:x1875967130906112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789062055.467305:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062055.467391:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c1482200/0x2774d8f311dc7a7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7a75 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062055.467424:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1482200/0x2774d8f311dc7a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7a75 expref: 17 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062055.467436:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c1482200/0x2774d8f311dc7a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a75 expref: 17 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062055.467455:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c1482200, rc 0) 00000100:00100000:2.0:1789062055.467503:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17112:x1875967130906112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062055.467687:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130906112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789062055.467706:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062055.467722:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7a7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062055.467804:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130906240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789062055.467834:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062055.467861:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c7ceb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789062055.467875:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130906240 00000100:00100000:1.0:1789062055.467879:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130906240 00000100:00100000:2.0:1789062055.468136:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789062055.469105:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789062055.469124:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17112:x1875967130906240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789062055.469699:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17112:x1875967130906240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 580us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062055.469708:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789062055.469839:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130906240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789062055.470849:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130906368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789062055.471461:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062055.471680:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c7ceb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789062055.471752:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130906368 00000100:00100000:2.0:1789062055.471763:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130906368 00000100:00100000:2.0:1789062055.471823:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789062055.471833:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17112:x1875967130906368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789062055.472756:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17112:x1875967130906368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 919us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062055.472768:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789062055.472953:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130906368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789062055.484283:0:18325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789062055.485242:0:17112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789062055.485284:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789062055.485302:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062055.485388:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062055.485402:0:17112:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789062055.485406:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767f7e7a800 from 13 10000000:01000000:2.0:1789062055.485409:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789062055.486138:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062055.486152:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062055.486167:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062055.486203:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130906496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789062055.486297:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062055.486366:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d10abc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789062055.487808:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130906496 00000100:00100000:3.0:1789062055.487822:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130906496 00000100:00100000:3.0:1789062055.488648:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789062055.488663:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+17:17112:x1875967130906496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789062055.488687:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062055.488712:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c807a600/0x2774d8f311dc7a8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7a83 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062055.488747:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c807a600/0x2774d8f311dc7a8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7a83 expref: 18 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062055.488759:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c807a600/0x2774d8f311dc7a8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a83 expref: 18 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062055.488770:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807a600, rc 0) 00000100:00100000:3.0:1789062055.488866:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17112:x1875967130906496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062055.488874:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789062055.489030:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130906496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789062055.489279:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a8a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062055.489292:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7a8a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062055.489394:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130906624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789062055.489711:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062055.489740:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130906624 00000100:00100000:3.0:1789062055.489742:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab0900 going to sleep for 11 seconds 00000100:00100000:1.0:1789062055.489749:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130906624 00000100:00100000:1.0:1789062055.489798:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789062055.489807:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17112:x1875967130906624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789062055.489972:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17112:x1875967130906624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062055.489981:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130906624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789062055.489988:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789062055.490015:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130906752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789062055.490067:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062055.490090:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab0900 going to sleep for 11 seconds 00000100:00100000:1.0:1789062055.490173:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130906752 00000100:00100000:1.0:1789062055.490178:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130906752 00000100:00100000:1.0:1789062055.490207:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789062055.490214:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17112:x1875967130906752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789062055.490314:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+18:17112:x1875967130906752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062055.490316:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130906752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789062055.490331:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000040:00080000:1.0:1789062055.491734:0:18327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789062055.496732:0:17112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789062055.496788:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789062055.496811:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a8a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062055.496826:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7a8a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062055.978057:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062056.617841:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130906880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789062056.617954:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062056.618062:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130906880 00000100:00100000:3.0:1789062056.618072:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130906880 00000100:00100000:3.0:1789062056.618342:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789062056.618355:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130906880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789062056.618403:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789062056.618466:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130906880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062056.618478:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789062056.618535:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130907008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789062056.618581:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062056.618679:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130906880:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789062056.618745:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789062056.618750:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789062056.618753:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789062056.618768:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789062056.618784:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789062056.618787:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789062056.618790:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789062056.618793:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789062056.619565:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130907136:0@lo:400:kworker.0 00000100:00100000:3.0:1789062056.619662:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062056.619678:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130907264:0@lo:400:kworker.0 00000100:00100000:3.0:1789062056.619739:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789062056.619751:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130907392:0@lo:400:kworker.0 00000100:00100000:2.0:1789062056.619758:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062056.619810:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062056.619837:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130907264 00000100:00100000:2.0:1789062056.620121:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130907264 00000100:00100000:2.0:1789062056.620166:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130907392 00000100:00100000:2.0:1789062056.620171:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130907392 00000100:00100000:2.0:1789062056.620188:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789062056.620196:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130907264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062056.620263:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130907264:12345-0@lo:400:kworker.0 Request processed in 67us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062056.620271:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789062056.620288:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789062056.620295:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130907392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062056.620324:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130907392:12345-0@lo:400:kworker.0 Request processed in 30us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062056.620330:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789062056.620406:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766c83e2d80 x1875967130907392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789062056.620423:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130907392:0@lo:400:kworker.0 00010000:00080000:2.0:1789062056.622667:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766c83e3480 x1875967130907264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062056.622687:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130907264:0@lo:400:kworker.0 00000100:00100000:2.0:1789062056.622730:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130907008 00000100:00100000:2.0:1789062056.622738:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130907008 00000100:00100000:2.0:1789062056.622787:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789062056.622797:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875967130907008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789062056.622829:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789062056.623526:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789062046/real 1789062046] req@ffff9766c748f800 x1875967130900864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062056 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062056.623546:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766c748f800 x1875967130900864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062056 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062056.623556:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789062046/real 1789062046] req@ffff9766c83e2680 x1875967130900736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062056 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062056.623568:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766c83e2680 x1875967130900736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062056 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789062056.623582:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062056.623620:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789062056.623624:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130900864:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789062056.623629:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3160000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062056.623635:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789062056.623638:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130900736:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789062056.623820:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130907136 00000100:00100000:1.0:1789062056.623827:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130907136 00000100:00100000:2.0:1789062056.624562:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875967130907008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1765us (5979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062056.624572:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789062056.624643:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130907008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789062056.625787:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789062056.625798:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:3622:x1875967130907136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062056.626121:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:3622:x1875967130907136:12345-0@lo:400:kworker.0 Request processed in 325us (6460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062056.626129:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789062056.626813:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062056.626819:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062056.626822:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062056.626826:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062056.626829:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062056.626832:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789062056.626835:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3160000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789062056.626841:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 427 00000100:00080000:1.0:1789062056.627140:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789062056.627150:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9767c3160000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062056.627183:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c8172a00 x1875967130907520/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789062056.627215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062056.627220:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789062056.627223:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789062056.627228:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 427 00000100:00080000:1.0:1789062056.627232:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789062056.627249:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9767c3f78000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062056.627267:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c8170e00 x1875967130907648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789062056.627643:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130907136:0@lo:400:kworker.0 00000100:00100000:2.0:1789062056.627991:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130907520:0@lo:8:kworker.0 00000400:00000100:2.0:1789062056.628045:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875967130907520 offset 0 length 520: 4 00000100:00100000:2.0:1789062056.628077:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130907648:0@lo:8:kworker.0 00000400:00000100:2.0:1789062056.628097:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875967130907648 offset 0 length 520: 4 00000001:00100000:2.0:1789062056.628642:0:17847:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789062057.001803:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062057.642684:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789062042/real 1789062042] req@ffff9766c748ca80 x1875967130898816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062057.642712:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766c748ca80 x1875967130898816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062057.642723:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789062042/real 1789062042] req@ffff9766c748ea00 x1875967130898944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062057.642735:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766c748ea00 x1875967130898944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789062057.642754:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f63000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062057.642769:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789062057.642773:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130898816:0@lo:8:kworker.0 00000100:00080000:1.0:1789062057.642780:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062057.642785:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789062057.642789:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130898944:0@lo:8:kworker.0 00000100:00080000:1.0:1789062057.644864:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062057.644871:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789062057.644875:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f63000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789062057.644883:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1789062057.644901:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789062057.644913:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9767c3f63000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062057.644935:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c8172d80 x1875967130908032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789062057.644950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062057.644953:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789062057.644956:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789062057.644959:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1789062057.644961:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789062057.644965:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9767c3f65800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062057.644976:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c8173800 x1875967130908160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789062057.644999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062057.645002:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062057.645004:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062057.645007:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789062057.645049:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130907904:0@lo:400:kworker.0 00000100:00100000:1.0:1789062057.645114:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062057.645149:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789062057.645156:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130908288:0@lo:400:kworker.0 00000100:00100000:1.0:1789062057.645184:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062057.645215:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130908032:0@lo:8:kworker.0 00000100:00100000:2.0:1789062057.645235:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83f5b9c6-643c-4659-afe5-bacf144ade05:3621:1875967130907776:0@lo:400:kworker.0 00000400:00000100:1.0:1789062057.645242:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875967130908032 offset 0 length 520: 4 00000100:00100000:1.0:1789062057.645269:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130908160:0@lo:8:kworker.0 00000100:00100000:2.0:1789062057.645294:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:1.0:1789062057.645307:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875967130908160 offset 0 length 520: 4 00000100:00100000:2.0:1789062057.645325:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130908544:0@lo:400:kworker.0 00000100:00100000:3.0:1789062057.646046:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130907904 00000100:00100000:3.0:1789062057.646063:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130907904 00000100:00100000:3.0:1789062057.646139:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789062057.646151:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130907904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062057.649923:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062057.649975:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789062057.649987:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130908416:0@lo:400:kworker.0 00000100:00100000:1.0:1789062057.649998:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130908288 00000100:00100000:1.0:1789062057.650007:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130908288 00000100:00100000:2.0:1789062057.650040:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062057.650070:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130908544 00000100:00100000:1.0:1789062057.650074:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130908544 00000100:00100000:1.0:1789062057.650092:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789062057.650101:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130908288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062057.650160:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130908288:12345-0@lo:400:kworker.0 Request processed in 60us (4974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062057.650168:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789062057.650189:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789062057.650195:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130908544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062057.650229:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130908544:12345-0@lo:400:kworker.0 Request processed in 35us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062057.650235:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789062057.650275:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766c8171180 x1875967130908288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062057.650289:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130908288:0@lo:400:kworker.0 00000100:00100000:2.0:1789062057.652872:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130907776 00000100:00100000:2.0:1789062057.652883:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130907776 00000100:00100000:2.0:1789062057.652932:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789062057.652941:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+18:3621:x1875967130907776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062057.653015:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+18:3621:x1875967130907776:12345-0@lo:400:kworker.0 Request processed in 75us (7736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062057.653022:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789062057.653070:0:17121:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789062057.653078:0:17121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789062057.653121:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83f5b9c6-643c-4659-afe5-bacf144ade05:3621:1875967130907776:0@lo:400:kworker.0 00010000:00080000:2.0:1789062057.653150:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766c75d5180 x1875967130908544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062057.653164:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130908544:0@lo:400:kworker.0 00000100:00100000:3.0:1789062057.654535:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130907904:12345-0@lo:400:kworker.0 Request processed in 8375us (9408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062057.654553:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789062057.654665:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130907904:0@lo:400:kworker.0 00000100:00100000:3.0:1789062057.654700:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130908416 00000100:00100000:3.0:1789062057.654707:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130908416 00000100:00100000:3.0:1789062057.654755:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789062057.654763:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130908416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062057.654841:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130908416:12345-0@lo:400:kworker.0 Request processed in 78us (4800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062057.654847:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789062057.654877:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130908416:0@lo:400:kworker.0 00010000:00010000:1.0:1789062058.030446:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789062058.733397:0:17867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789062059.052405:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062060.076380:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062061.106732:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789062061.458588:0:18615:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789062061.458591:0:18615:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789062061.458597:0:18615:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789062061.459274:0:18615:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9767fb31a800 00000020:01000004:2.0:1789062061.459289:0:18615:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789062061.459302:0:18615:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789062061.459315:0:18615:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9767f38a8000) 00000020:00000080:2.0:1789062061.459331:0:18615:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789062061.564035:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789062061.564636:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789062061.565164:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789062061.565407:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789062061.566063:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789062061.566333:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789062061.566587:0:18615:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1789062061.574595:0:18615:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789062061.575126:0:18615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789062061.575139:0:18615:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789062061.575150:0:18615:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2774d8f311dc7a98 00000020:01000004:2.0:1789062061.575158:0:18615:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789062061.575177:0:18615:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789062061.575180:0:18615:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789062061.575186:0:18615:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789062061.575190:0:18615:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789062061.575200:0:18615:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9767f38acd40) 00000020:00000080:2.0:1789062061.575210:0:18615:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789062061.576280:0:18615:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789062061.576436:0:18615:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789062061.576441:0:18615:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789062061.587678:0:18615:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789062061.587691:0:18615:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789062061.588139:0:18615:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789062061.588152:0:18615:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789062061.590576:0:18615:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789062061.596061:0:18615:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789062061.596071:0:18615:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789062061.596924:0:18615:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789062061.596932:0:18615:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789062061.614265:0:18615:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789062061.614953:0:18615:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789062061.614961:0:18615:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789062061.616159:0:18615:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789062061.616168:0:18615:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789062061.617157:0:18615:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789062061.617165:0:18615:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789062061.630137:0:18615:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789062061.631077:0:18615:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789062061.631084:0:18615:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789062061.631886:0:18615:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789062061.631893:0:18615:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789062061.670077:0:18615:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789062061.670404:0:18615:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789062061.670411:0:18615:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789062061.674052:0:18615:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789062061.674146:0:18615:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789062061.674771:0:18615:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789062061.674800:0:18615:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789062061.674806:0:18615:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789062061.697778:0:18615:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789062061.697831:0:18615:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789062061.697836:0:18615:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789062061.697837:0:18615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789062061.697839:0:18615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789062061.697840:0:18615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789062061.697841:0:18615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789062061.697843:0:18615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789062061.697844:0:18615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789062061.697847:0:18615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789062061.697849:0:18615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789062061.697853:0:18615:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789062061.697862:0:18615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789062061.697863:0:18615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789062061.697864:0:18615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789062061.697865:0:18615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789062061.697866:0:18615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789062061.697867:0:18615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789062061.697867:0:18615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789062061.697869:0:18615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789062061.697869:0:18615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789062061.697907:0:18615:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789062061.697929:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130908672:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789062061.698009:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062061.698120:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c34260c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062061.705283:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130908672 00000100:00100000:1.0:1789062061.705297:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130908672 00000100:00100000:1.0:1789062061.705357:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789062061.705368:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+18:18615:x1875967130908672:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789062061.705445:0:17109:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789062061.705449:0:17109:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789062061.705453:0:17109:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789062061.705972:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+18:18615:x1875967130908672:12345-0@lo:253:mount.lustre.0 Request processed in 605us (7960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062061.705980:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789062061.706179:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130908672:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789062061.706194:0:18615:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789062061.706197:0:18615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789062061.706199:0:18615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789062061.706200:0:18615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789062061.706201:0:18615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789062061.706203:0:18615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789062061.706204:0:18615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789062061.706206:0:18615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789062061.706207:0:18615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789062061.706209:0:18615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789062061.706229:0:18615:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9767fb31a800 from lustre-OST0000 10000000:01000000:3.0:1789062061.706270:0:18615:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789062061.706273:0:18615:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789062061.706281:0:18615:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9767fb3299c0 local copy 00010000:00010000:3.0:1789062061.706291:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062061.706415:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130908800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062061.706451:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062061.706487:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789062061.706901:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130908800 00000100:00100000:1.0:1789062061.706907:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130908800 00000100:00100000:1.0:1789062061.706945:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789062061.706953:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:18615:x1875967130908800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789062061.707035:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+18:18615:x1875967130908800:12345-0@lo:501:mount.lustre.0 Request processed in 82us (582us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789062061.707041:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789062061.707221:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130908800:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789062061.707236:0:18615:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789062061.707253:0:18615:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789062061.707260:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.707269:0:18615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789062061.707292:0:18615:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9767fb31a800 10000000:01000000:3.0:1789062061.707297:0:18615:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789062061.707302:0:18615:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789062061.707305:0:18615:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789062061.707309:0:18615:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789062061.707312:0:18615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789062061.707334:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7aa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.707341:0:18615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7aa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.707349:0:18615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7aa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062061.707385:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130908928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789062061.707414:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062061.707440:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789062061.707589:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130908928 00000100:00100000:1.0:1789062061.707603:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130908928 00000100:00100000:1.0:1789062061.707657:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789062061.707664:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+18:18615:x1875967130908928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789062061.707673:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789062061.707684:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47b000/0x2774d8f311dc7aad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7aa6 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.707704:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b000/0x2774d8f311dc7aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7aa6 expref: 19 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.707715:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47b000/0x2774d8f311dc7aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7aa6 expref: 19 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.707724:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b000, rc 0) 00000100:00100000:1.0:1789062061.707770:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+19:18615:x1875967130908928:12345-0@lo:101:mount.lustre.0 Request processed in 106us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062061.707777:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789062061.707886:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130908928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789062061.707909:0:18615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7aa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7aad expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.707917:0:18615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7aa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7aad expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789062061.709720:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789062061.711559:0:18615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789062061.714947:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789062061.715031:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789062061.715059:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789062061.715074:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789062061.715089:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789062061.715104:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789062061.715129:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789062061.715134:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789062061.716425:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130909056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062061.716491:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062061.716585:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd435e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789062061.718755:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130909056 00000100:00100000:1.0:1789062061.718768:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130909056 00000100:00100000:1.0:1789062061.719014:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789062061.719025:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+19:18615:x1875967130909056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789062061.719220:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+19:18615:x1875967130909056:12345-0@lo:501:mount.lustre.0 Request processed in 196us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062061.719228:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789062061.719312:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130909056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789062061.719358:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130909184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789062061.719410:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062061.719739:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c72e8000 going to sleep for 11 seconds 00000100:00100000:2.0:1789062061.719920:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130909184 00000100:00100000:2.0:1789062061.719926:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130909184 00000100:00100000:2.0:1789062061.719953:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789062061.719960:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+19:18615:x1875967130909184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789062061.721766:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+19:18615:x1875967130909184:12345-0@lo:503:mount.lustre.0 Request processed in 1799us (2349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062061.721778:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789062061.722983:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130909184:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789062061.725561:0:18615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789062061.726313:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130909312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789062061.726456:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062061.726548:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c72e8000 going to sleep for 11 seconds 00000100:00100000:1.0:1789062061.732483:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130909312 00000100:00100000:1.0:1789062061.732497:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130909312 00000100:00100000:1.0:1789062061.732561:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789062061.732572:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+19:18615:x1875967130909312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789062061.738522:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130909440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789062061.738593:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062061.738702:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130909440 00000100:00100000:0.0:1789062061.738710:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130909440 00000100:00100000:0.0:1789062061.738759:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789062061.738768:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130909440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789062061.738801:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789062061.738849:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130909440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062061.738872:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789062061.738954:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130909440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789062061.740793:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+19:18615:x1875967130909312:12345-0@lo:502:mount.lustre.0 Request processed in 8218us (14332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062061.740816:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789062061.741990:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130909312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789062061.742421:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789062061.742455:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789062061.742471:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789062061.742486:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789062061.742499:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789062061.742513:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789062061.742527:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789062061.742541:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789062061.742556:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789062061.742570:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789062061.742584:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789062061.742599:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789062061.742958:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130909568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789062061.743042:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062061.743084:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d696ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789062061.744326:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130909568 00000100:00100000:2.0:1789062061.744334:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130909568 00000100:00100000:2.0:1789062061.744396:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789062061.744406:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+19:18615:x1875967130909568:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062061.744536:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+19:18615:x1875967130909568:12345-0@lo:502:mount.lustre.0 Request processed in 132us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062061.744544:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789062061.744772:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130909568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789062061.745331:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789062061.745346:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000100:00100000:3.0:1789062061.747359:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130909696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789062061.747440:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062061.747501:0:18432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130909696 00000100:00100000:3.0:1789062061.747508:0:18432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130909696 00000100:00100000:3.0:1789062061.747552:0:18432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789062061.747561:0:18432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130909696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789062061.747595:0:18432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789062061.747658:0:18432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130909696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062061.747665:0:18432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789062061.747726:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130909696:0@lo:41:osp-pre-1-0.0 00000020:01000000:0.0:1789062061.754476:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789062061.754488:0:18633:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789062061.754495:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062061.754497:0:18633:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789062061.754505:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789062061.754522:0:18633:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9767fa37b380) 00000020:00000080:0.0:1789062061.754549:0:18633:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789062061.754556:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789062061.754710:0:18633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767fb31a800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789062061.754717:0:18633:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789062061.754724:0:18633:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2774d8f311dc7abb 00010000:00010000:0.0:1789062061.760098:0:18633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1789062061.761499:0:18633:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1789062061.763109:0:18633:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789062061.765472:0:18633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789062061.765485:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062061.765712:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062061.765716:0:18633:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789062061.765722:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789062061.765725:0:18633:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1789062061.765726:0:18633:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789062061.765728:0:18633:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789062061.765730:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789062061.765733:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062061.765735:0:18633:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789062061.765738:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062061.765742:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062061.765743:0:18633:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789062061.765746:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789062061.765749:0:18633:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789062061.765751:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062061.765753:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062061.765754:0:18633:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789062061.765756:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789062061.765759:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062061.765760:0:18633:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789062061.765763:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789062061.765786:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789062061.765790:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789062061.765791:0:18633:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789062061.765794:0:18633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789062061.766124:0:18615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789062061.766289:0:18615:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789062061.766377:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7aa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7aad expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062061.766389:0:18615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c807a800/0x2774d8f311dc7aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7aad expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062061.766397:0:18615:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fb31a800 from 1 10000000:01000000:2.0:1789062061.766400:0:18615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789062061.766445:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062061.766454:0:18615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062061.766464:0:18615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062061.766486:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130909824:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789062061.766549:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062061.766594:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd435480 going to sleep for 11 seconds 00000100:00100000:1.0:1789062061.768099:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130909824 00000100:00100000:1.0:1789062061.768118:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130909824 00000100:00100000:1.0:1789062061.768278:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789062061.768289:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+19:18615:x1875967130909824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789062061.768306:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789062061.768323:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47a600/0x2774d8f311dc7ac9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7ac2 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.768349:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47a600/0x2774d8f311dc7ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7ac2 expref: 20 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.768360:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47a600/0x2774d8f311dc7ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7ac2 expref: 20 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.768369:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a600, rc 0) 00000100:00100000:1.0:1789062061.768444:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+20:18615:x1875967130909824:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062061.768451:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789062061.768601:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130909824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062061.768639:0:18615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7ac9 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062061.768648:0:18615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7ac9 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789062061.771279:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789062061.771530:0:18615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789062061.771943:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789062061.771971:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789062061.771985:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789062061.771989:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789062061.772066:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130909952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062061.772133:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062061.772191:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd435600 going to sleep for 11 seconds 00000100:00100000:3.0:1789062061.772285:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130909952 00000100:00100000:3.0:1789062061.772293:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130909952 00000100:00100000:3.0:1789062061.772343:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789062061.772353:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+20:18615:x1875967130909952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062061.772804:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130909952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062061.772836:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789062061.772867:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+20:18615:x1875967130909952:12345-0@lo:501:mount.lustre.0 Request processed in 514us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062061.772882:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062061.772904:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd435600 going to sleep for 11 seconds 00000100:00100000:2.0:1789062061.772920:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130910080 00000100:00100000:2.0:1789062061.772925:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130910080 00000100:00100000:3.0:1789062061.773050:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789062061.773798:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789062061.773948:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+20:18615:x1875967130910080:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789062061.774481:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+20:18615:x1875967130910080:12345-0@lo:503:mount.lustre.0 Request processed in 536us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062061.774489:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789062061.774698:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910080:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789062061.776066:0:18615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789062061.776723:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062061.776796:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062061.776987:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd435480 going to sleep for 11 seconds 00000100:00100000:0.0:1789062061.781362:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130910208 00000100:00100000:0.0:1789062061.781387:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130910208 00000100:00100000:0.0:1789062061.781442:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789062061.781452:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+20:18615:x1875967130910208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789062061.781628:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+20:18615:x1875967130910208:12345-0@lo:502:mount.lustre.0 Request processed in 177us (4832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062061.781636:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789062061.781935:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789062061.783983:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789062061.784048:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789062061.784091:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789062061.784107:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789062061.784120:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789062061.784132:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789062061.784704:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789062061.784731:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789062061.784747:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789062061.784774:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789062061.784787:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789062061.784840:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062061.784915:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062061.785481:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd435480 going to sleep for 11 seconds 00000100:00100000:3.0:1789062061.789316:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130910336 00000100:00100000:3.0:1789062061.789330:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130910336 00000100:00100000:3.0:1789062061.789501:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789062061.789512:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+20:18615:x1875967130910336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789062061.790586:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+20:18615:x1875967130910336:12345-0@lo:502:mount.lustre.0 Request processed in 1074us (5669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062061.790597:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789062061.795367:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789062061.796025:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789062061.796041:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789062061.796967:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789062061.796977:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062061.796980:0:18637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789062061.796986:0:18637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767fb31a800 00000020:00000080:0.0:1789062061.796988:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789062061.797007:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789062061.797010:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062061.797017:0:18637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789062061.797021:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789062061.797024:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062061.797025:0:18637:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789062061.797028:0:18637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767fb31a800 00000020:00000080:0.0:1789062061.797031:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789062061.797086:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789062061.797090:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062061.797091:0:18637:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789062061.797093:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789062061.797095:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062061.797097:0:18637:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789062061.797100:0:18637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767fb31a800 00000020:00000080:0.0:1789062061.797101:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789062061.797130:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789062061.797134:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062061.797135:0:18637:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789062061.799354:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789062061.799369:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062061.799371:0:18637:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789062061.799390:0:18637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767fb31a800 00000020:00000080:0.0:1789062061.799393:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789062061.799450:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789062061.799454:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062061.799456:0:18637:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789062061.799459:0:18637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789062061.799669:0:18615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789062061.799701:0:18615:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789062061.799719:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7ac9 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062061.799731:0:18615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7ac9 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062061.799786:0:18615:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789062061.799790:0:18615:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9767fb31a800 10000000:01000000:2.0:1789062061.799793:0:18615:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9767fb31a800 10000000:01000000:2.0:1789062061.799797:0:18615:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789062061.799803:0:18615:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767fb31a800 from 1 10000000:01000000:2.0:1789062061.799805:0:18615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789062061.799842:0:18615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc7ad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062061.799850:0:18615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc7ad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062061.799861:0:18615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc7ad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062061.799898:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789062061.799958:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062061.799994:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd435600 going to sleep for 11 seconds 00000100:00100000:3.0:1789062061.800241:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130910464 00000100:00100000:3.0:1789062061.800248:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130910464 00000100:00100000:3.0:1789062061.800289:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789062061.800297:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+20:18615:x1875967130910464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789062061.800310:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062061.800323:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c807a400/0x2774d8f311dc7ad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7ad0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.800352:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c807a400/0x2774d8f311dc7ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7ad0 expref: 21 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.800363:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c807a400/0x2774d8f311dc7ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7ad0 expref: 21 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.800381:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807a400, rc 0) 00000100:00100000:3.0:1789062061.800430:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130910464:12345-0@lo:101:mount.lustre.0 Request processed in 133us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062061.800436:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789062061.803380:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062061.803407:0:18615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc7ad0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7ad7 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062061.803419:0:18615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc7ad0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7ad7 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789062061.806769:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789062061.807056:0:18615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789062061.807257:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789062061.807282:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789062061.807295:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789062061.807307:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789062061.807321:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789062061.807333:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789062061.807344:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789062061.807357:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789062061.807371:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789062061.807397:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789062061.807410:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789062061.807422:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789062061.807435:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789062061.807448:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789062061.807460:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789062061.807487:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789062061.807503:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789062061.807526:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789062061.807540:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789062061.807551:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789062061.807563:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789062061.807575:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789062061.807588:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789062061.807602:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789062061.807808:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789062061.807822:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789062061.807834:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789062061.807846:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789062061.807858:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789062061.807870:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789062061.807882:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789062061.807912:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789062061.807926:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789062061.807936:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789062061.807948:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789062061.807959:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789062061.807969:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789062061.807987:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789062061.807992:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789062061.808087:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062061.808681:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062061.812091:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd435a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789062061.817006:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130910592 00000100:00100000:0.0:1789062061.817021:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130910592 00000100:00100000:0.0:1789062061.817073:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789062061.817084:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130910592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789062061.817436:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130910592:12345-0@lo:501:mount.lustre.0 Request processed in 354us (8754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062061.817454:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789062061.825400:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062061.825760:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789062061.825846:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062061.825886:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd48a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789062061.827527:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130910720 00000100:00100000:1.0:1789062061.827538:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130910720 00000100:00100000:1.0:1789062061.827587:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789062061.827596:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130910720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789062061.827744:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130910720:12345-0@lo:503:mount.lustre.0 Request processed in 148us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062061.827751:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789062061.829513:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910720:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789062061.829924:0:18615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789062061.830012:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062061.830080:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062061.830119:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd435600 going to sleep for 11 seconds 00000100:00100000:1.0:1789062061.831745:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130910848 00000100:00100000:1.0:1789062061.831757:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130910848 00000100:00100000:1.0:1789062061.831811:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789062061.831821:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130910848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789062061.831970:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130910848:12345-0@lo:502:mount.lustre.0 Request processed in 150us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062061.831979:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789062061.837915:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789062061.838160:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789062061.838190:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789062061.838204:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789062061.838218:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789062061.838229:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789062061.838241:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789062061.838253:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789062061.838265:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789062061.838277:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789062061.838291:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789062061.838303:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789062061.838314:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789062061.838325:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789062061.838337:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789062061.838352:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789062061.838364:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789062061.840553:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789062061.840584:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789062061.840597:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789062061.840626:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789062061.840641:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789062061.840654:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789062061.840666:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789062061.840679:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789062061.840693:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789062061.840705:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789062061.840716:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789062061.840729:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789062061.840754:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789062061.840769:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789062061.840782:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789062061.840793:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789062061.840826:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789062061.840842:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789062061.840855:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789062061.840867:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789062061.840880:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789062061.840893:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789062061.840906:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789062061.840918:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789062061.840929:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789062061.840942:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789062061.840954:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789062061.840966:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789062061.840979:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789062061.840992:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789062061.841018:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789062061.841032:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789062061.841101:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789062061.841175:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062061.841220:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1f970c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789062061.841477:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130910976 00000100:00100000:2.0:1789062061.841485:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130910976 00000100:00100000:2.0:1789062061.841541:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789062061.841550:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130910976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062061.841686:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130910976:12345-0@lo:502:mount.lustre.0 Request processed in 136us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062061.841694:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789062061.841916:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130910976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789062061.842092:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789062061.842114:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789062061.842138:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130911104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789062061.842172:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062061.842204:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1f970c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789062061.843718:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130911104 00000100:00100000:2.0:1789062061.843728:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130911104 00000100:00100000:2.0:1789062061.843778:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789062061.843786:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130911104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062061.843917:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130911104:12345-0@lo:502:mount.lustre.0 Request processed in 132us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062061.843924:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789062061.844063:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130911104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789062061.844132:0:18615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789062061.844142:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789062061.844975:0:18642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789062061.844989:0:18642:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9767f38ab380) 00000020:00000080:2.0:1789062061.845032:0:18642:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789062061.845114:0:18642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767fb31a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789062061.845120:0:18642:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767fb31a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789062061.845122:0:18642:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fb31a800 3 00010000:00080000:2.0:1789062061.845157:0:18642:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9766c8436800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1789062061.846759:0:18642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789062061.846957:0:18642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789062061.847008:0:18642:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789062061.847023:0:18642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2774d8f311dc7ae5 00000100:00080000:2.0:1789062061.847032:0:18642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789062061.847049:0:18642:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9766c8436800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062061.847083:0:18642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c748c700 x1875967130911232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789062061.847130:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875967130911232:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789062061.847201:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062061.847262:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130911232 00000100:00100000:2.0:1789062061.847269:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130911232 00000100:00100000:2.0:1789062061.847295:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789062061.847302:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875967130911232:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789062061.847323:0:17116:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:2.0:1789062061.847359:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2774d8f311dc7aec 00000004:00100000:2.0:1789062061.847372:0:17116:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789062061.847401:0:17116:0:(import.c:65:import_set_state_nolock()) ffff9766c8434800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789062061.847447:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875967130911232:12345-0@lo:38:llog_process_th.0 Request processed in 144us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062061.847454:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789062061.847490:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766c748c700 x1875967130911232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789062071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062061.847499:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789062061.847505:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789062061.847511:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789062061.847514:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789062061.847517:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9766c8436800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789062061.847521:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875967130911232:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789062061.847538:0:18642:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789062061.849483:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789062061.849492:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789062061.849494:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789062061.849497:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789062061.849544:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789062061.849547:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789062061.849550:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789062061.849553:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789062061.855077:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130911360:0@lo:400:kworker.0 00000100:00100000:3.0:1789062061.855149:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062061.855187:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789062061.855194:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130911488:0@lo:400:kworker.0 00000100:00100000:3.0:1789062061.855215:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062061.855478:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130911360 00000100:00100000:3.0:1789062061.855486:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130911360 00000100:00100000:3.0:1789062061.855524:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130911488 00000100:00100000:3.0:1789062061.855528:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130911488 00000100:00100000:3.0:1789062061.855543:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789062061.855550:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130911360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062061.855597:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130911360:12345-0@lo:400:kworker.0 Request processed in 47us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062061.855646:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789062061.855661:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789062061.855666:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130911488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062061.855703:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130911488:12345-0@lo:400:kworker.0 Request processed in 37us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062061.855708:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789062061.855745:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766c81a9f80 x1875967130911488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789062061.855759:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130911488:0@lo:400:kworker.0 00010000:00080000:3.0:1789062061.855771:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766c81ab480 x1875967130911360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789062061.855780:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130911360:0@lo:400:kworker.0 00000020:01000004:2.0:1789062061.856723:0:18642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789062061.856762:0:18642:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9767f38319c0) 00000020:00000080:2.0:1789062061.856787:0:18642:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1789062061.856882:0:18642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767fb31a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789062061.856886:0:18642:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767fb31a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789062061.856889:0:18642:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767fb31a800 3 00010000:00080000:2.0:1789062061.856917:0:18642:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9766c8437800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1789062061.865097:0:18642:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1789062061.865285:0:18642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789062061.865331:0:18642:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789062061.865343:0:18642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2774d8f311dc7afa 00000100:00080000:2.0:1789062061.865352:0:18642:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789062061.865364:0:18642:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9766c8437800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062061.867492:0:18642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c748c700 x1875967130911616/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789062061.867528:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875967130911616:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789062061.867589:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789062061.869174:0:18642:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789062061.869483:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062061.869489:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062061.869492:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062061.869495:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062061.869499:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062061.869502:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062061.869505:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062061.869507:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789062061.869600:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130911616 00000100:00100000:3.0:1789062061.869630:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130911616 00000100:00100000:3.0:1789062061.869668:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789062061.869675:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875967130911616:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789062061.869704:0:17117:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:3.0:1789062061.869739:0:17117:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2774d8f311dc7b01 00000004:00100000:3.0:1789062061.869752:0:17117:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789062061.869783:0:17117:0:(import.c:65:import_set_state_nolock()) ffff9767c9fbb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789062061.869854:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875967130911616:12345-0@lo:38:llog_process_th.0 Request processed in 177us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062061.869861:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789062061.869983:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766c748c700 x1875967130911616/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789062071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789062061.870010:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789062061.870018:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789062061.870026:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789062061.870030:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789062061.870032:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9766c8437800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789062061.870038:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875967130911616:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789062061.871544:0:18642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789062061.871685:0:18615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789062061.871714:0:18615:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789062061.871736:0:18615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc7ad0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7ad7 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.871748:0:18615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1482600/0x2774d8f311dc7ad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7ad7 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789062061.871795:0:18615:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789062061.871797:0:18615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789062061.871798:0:18615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789062061.871799:0:18615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789062061.871800:0:18615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789062061.871802:0:18615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789062061.871803:0:18615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789062061.871809:0:18615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789062061.871810:0:18615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789062061.871814:0:18615:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789062061.871816:0:18615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789062061.871817:0:18615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789062061.871818:0:18615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789062061.871819:0:18615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789062061.871820:0:18615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789062061.871821:0:18615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789062061.871821:0:18615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789062061.871822:0:18615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789062061.871823:0:18615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789062061.871845:0:18615:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789062061.871861:0:18615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130911744:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789062061.871917:0:18615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062061.871950:0:18615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd49e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789062061.872025:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130911744 00000100:00100000:0.0:1789062061.872032:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130911744 00000100:00100000:0.0:1789062061.872106:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789062061.872114:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130911744:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789062061.872136:0:17109:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789062061.872149:0:17109:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789062061.889512:0:17109:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789062061.889532:0:17109:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789062061.890183:0:17131:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789062061.890188:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789062061.890208:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.890227:0:17131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c80cec00/0x2774d8f311dc7a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a4b expref: 21 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.890234:0:17131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c80ce200/0x2774d8f311dc7a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a59 expref: 21 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.890241:0:17131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.890277:0:17131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c80ce200/0x2774d8f311dc7a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7a59 expref: 21 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.890293:0:17131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766c80ce200/0x2774d8f311dc7a60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7a59 expref: 21 pid: 17110 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062061.890307:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130911872:0@lo:104: 00000100:00100000:3.0:1789062061.890344:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789062061.890633:0:17131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c80cec00/0x2774d8f311dc7a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7a4b expref: 21 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.890642:0:17131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766c80cec00/0x2774d8f311dc7a52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7a4b expref: 21 pid: 17109 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062061.890651:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130912000:0@lo:104: 00000100:00100000:0.0:1789062061.890817:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:18615:x1875967130911744:12345-0@lo:253:mount.lustre.0 Request processed in 18702us (18898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062061.890827:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789062061.892357:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062061.892488:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d11ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1789062061.892561:0:18615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:18615:1875967130911744:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789062061.892575:0:18615:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789062061.892579:0:18615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789062061.892581:0:18615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789062061.892582:0:18615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789062061.892583:0:18615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789062061.892585:0:18615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789062061.892586:0:18615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789062061.892587:0:18615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789062061.892589:0:18615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789062061.892591:0:18615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789062061.892637:0:18615:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789062061.893218:0:17099:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789062061.893234:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130911872 00000100:00100000:1.0:1789062061.893240:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130911872 00000100:00100000:1.0:1789062061.893274:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130912000 00000100:00100000:1.0:1789062061.893277:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130912000 00000100:00100000:1.0:1789062061.893290:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789062061.893298:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+4:17131:x1875967130911872:12345-0@lo:104: 00010000:00010000:1.0:1789062061.893312:0:17099:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7a60 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.893390:0:17099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789062061.893396:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+4:17131:x1875967130911872:12345-0@lo:104: Request processed in 99us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062061.893403:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789062061.893420:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789062061.893427:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7c7e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+3:17131:x1875967130912000:12345-0@lo:104: 00010000:00010000:1.0:1789062061.893443:0:17099:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7a52 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.893476:0:17099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789062061.893481:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7c7e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+3:17131:x1875967130912000:12345-0@lo:104: Request processed in 55us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062061.893487:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789062061.893521:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789062061.893527:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7a60 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.893534:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf200 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789062061.893538:0:17103:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7a60 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.893545:0:17103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7a60 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789062061.893551:0:17103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7a60 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789062061.893556:0:17103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789062061.893584:0:17103:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a60 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.893591:0:17103:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789062061.893631:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a60 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.893639:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c80cf200/0x2774d8f311dc7a59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a60 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.893658:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789062061.893661:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7a52 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.893666:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199800 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789062061.893669:0:17103:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7a52 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.893676:0:17103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7a52 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789062061.893681:0:17103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7a52 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789062061.893686:0:17103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789062061.893700:0:17103:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a52 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.893705:0:17103:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789062061.893711:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a52 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.893717:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c8199800/0x2774d8f311dc7a4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a52 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062061.893729:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062061.893730:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062061.893732:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062061.893739:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789062061.894915:0:18615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789062061.895049:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130911872:0@lo:104: 00000100:00100000:2.0:1789062061.895061:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130912000:0@lo:104: 00010000:00010000:2.0:1789062061.895081:0:17131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062061.897070:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130912128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789062061.897135:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062061.897179:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789062061.897186:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130912256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789062061.897211:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062061.897247:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130912128 00000100:00100000:3.0:1789062061.897254:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130912128 00010000:00010000:3.0:1789062061.897283:0:17102:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c80ce200/0x2774d8f311dc7a60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7a59 expref: 21 pid: 17110 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062061.897309:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130912256 00000100:00100000:3.0:1789062061.897312:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130912256 00010000:00010000:3.0:1789062061.897325:0:17102:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c80cec00/0x2774d8f311dc7a52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7a4b expref: 22 pid: 17109 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062061.897339:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789062061.897346:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83f5b9c6-643c-4659-afe5-bacf144ade05+22:3622:x1875967130912128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789062061.897357:0:17102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789062061.897362:0:17102:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9766c80ce200/0x2774d8f311dc7a60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7a59 expref: 22 pid: 17110 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897395:0:17102:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c80ce200/0x2774d8f311dc7a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7a59 expref: 22 pid: 17110 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897411:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c80ce200/0x2774d8f311dc7a60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7a59 expref: 22 pid: 17110 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897428:0:17102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062061.897465:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83f5b9c6-643c-4659-afe5-bacf144ade05+21:3622:x1875967130912128:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062061.897471:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789062061.897486:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789062061.897492:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7772850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83f5b9c6-643c-4659-afe5-bacf144ade05+20:3622:x1875967130912256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789062061.897499:0:17102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789062061.897503:0:17102:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9766c80cec00/0x2774d8f311dc7a52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7a4b expref: 20 pid: 17109 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897512:0:17102:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c80cec00/0x2774d8f311dc7a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7a4b expref: 20 pid: 17109 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897521:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c80cec00/0x2774d8f311dc7a52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7a4b expref: 20 pid: 17109 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897531:0:17102:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897540:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789062061.897554:0:17102:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007365808s 00010000:00010000:3.0:1789062061.897565:0:17102:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897573:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897579:0:17102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897586:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897593:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b000 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789062061.897598:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897629:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897645:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897655:0:17102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062061.897680:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7772850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83f5b9c6-643c-4659-afe5-bacf144ade05+19:3622:x1875967130912256:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062061.897688:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789062061.897747:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130912256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789062061.897755:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130912128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789062061.897777:0:17131:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897795:0:17131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062061.897811:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c807b000/0x2774d8f311dc7b08 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789062061.899740:0:18615:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789062061.899749:0:18615:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789062061.899788:0:18615:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789062061.899844:0:18615:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789062061.899863:0:18615:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789062061.899879:0:18615:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789062061.904581:0:18615:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789062061.904981:0:18615:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789062062.130396:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789062062.794168:0:18696:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789062062.795028:0:18696:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789062063.145780:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789062063.209693:0:17112:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789062063.209702:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767fb2fe000 from 9 10000000:01000000:0.0:1789062063.209707:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789062063.209758:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062063.209770:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062063.209781:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062063.209805:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130912384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789062063.209872:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062063.209925:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727180 going to sleep for 11 seconds 00000100:00100000:2.0:1789062063.209932:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130912384 00000100:00100000:2.0:1789062063.209940:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130912384 00000100:00100000:2.0:1789062063.210010:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789062063.210019:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+19:17112:x1875967130912384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789062063.210033:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062063.210049:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc7b16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7b0f expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062063.210071:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc7b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7b0f expref: 20 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062063.210082:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc7b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7b0f expref: 20 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062063.210090:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c1482c00, rc 0) 00000100:00100000:2.0:1789062063.210142:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+20:17112:x1875967130912384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062063.210149:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789062063.210229:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130912384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789062063.210244:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7b16 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062063.210254:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7b16 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062063.210306:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130912512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789062063.210338:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062063.210363:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727180 going to sleep for 11 seconds 00000100:00100000:2.0:1789062063.210411:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130912512 00000100:00100000:2.0:1789062063.210416:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130912512 00000100:00100000:2.0:1789062063.210452:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789062063.210466:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+20:17112:x1875967130912512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789062063.210481:0:17109:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789062063.210496:0:17109:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789062063.210499:0:17109:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789062063.210580:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+20:17112:x1875967130912512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062063.210587:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789062063.210759:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130912512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789062063.210817:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789062063.210823:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7b16 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062063.210831:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7b16 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789062063.210851:0:17112:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789062063.210853:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767f7e7a800 from 9 10000000:01000000:0.0:1789062063.210855:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789062063.210872:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062063.210878:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062063.210886:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062063.210898:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130912640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789062063.210927:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062063.210954:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727180 going to sleep for 11 seconds 00000100:00100000:3.0:1789062063.211009:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130912640 00000100:00100000:3.0:1789062063.211014:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130912640 00000100:00100000:3.0:1789062063.211046:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789062063.211053:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+20:17112:x1875967130912640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789062063.211062:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062063.211071:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c807a200/0x2774d8f311dc7b24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7b1d expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062063.211085:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c807a200/0x2774d8f311dc7b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7b1d expref: 21 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062063.211093:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c807a200/0x2774d8f311dc7b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7b1d expref: 21 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062063.211098:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807a200, rc 0) 00000100:00100000:3.0:1789062063.211127:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:17112:x1875967130912640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062063.211133:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789062063.211301:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130912640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789062063.211312:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7b24 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062063.211319:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7b24 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062063.211363:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130912768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789062063.211387:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062063.211407:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727180 going to sleep for 11 seconds 00000100:00100000:3.0:1789062063.211449:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130912768 00000100:00100000:3.0:1789062063.211454:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130912768 00000100:00100000:3.0:1789062063.211481:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789062063.211487:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:17112:x1875967130912768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789062063.211506:0:17109:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789062063.211516:0:17109:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789062063.211518:0:17109:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789062063.211589:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:17112:x1875967130912768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062063.211596:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789062063.211697:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130912768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789062063.211734:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789062063.211739:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7b24 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062063.211747:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7b24 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062064.170813:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789062064.618347:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789062065.196545:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062066.220456:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062066.864214:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130913024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789062066.864590:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130912896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789062066.864688:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062066.864988:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062066.865039:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130912896 00000100:00100000:3.0:1789062066.865048:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130912896 00000100:00100000:3.0:1789062066.865100:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130913024 00000100:00100000:3.0:1789062066.865103:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130913024 00000100:00100000:3.0:1789062066.865122:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789062066.865132:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130912896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789062066.865186:0:17121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789062066.866597:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789062066.866630:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130913024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789062066.866670:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789062066.866755:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130913024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062066.866762:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789062066.866952:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130912896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1818us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062066.866970:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789062066.867037:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130913024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789062066.867101:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130912896:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789062067.241804:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789062067.370018:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062067.370026:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062067.370030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062067.370033:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062067.370063:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062067.370067:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789062067.370070:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789062067.370074:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789062067.370185:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130913152:0@lo:400:kworker.0 00000100:00100000:1.0:1789062067.370276:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062067.370324:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130913664:0@lo:400:kworker.0 00000100:00100000:1.0:1789062067.370355:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062067.370525:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789062067.370532:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130913280:0@lo:400:kworker.0 00000100:00100000:1.0:1789062067.370563:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062067.370593:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130913792:0@lo:400:kworker.0 00000100:00100000:1.0:1789062067.370644:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062067.370676:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130913408:0@lo:400:kworker.0 00000100:00100000:2.0:1789062067.370789:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130913280 00000100:00100000:2.0:1789062067.370800:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130913280 00000100:00100000:2.0:1789062067.370857:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789062067.370869:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130913280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062067.370941:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130913280:12345-0@lo:400:kworker.0 Request processed in 73us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062067.370948:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789062067.371014:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130913280:0@lo:400:kworker.0 00000100:00100000:1.0:1789062067.371089:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062067.371134:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130913920:0@lo:400:kworker.0 00000100:00100000:1.0:1789062067.371163:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062067.371176:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789062067.371182:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130913536:0@lo:400:kworker.0 00000100:00100000:1.0:1789062067.371203:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062067.371257:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130913152 00000100:00100000:1.0:1789062067.371262:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130913152 00000100:00100000:1.0:1789062067.371299:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789062067.371306:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:3622:x1875967130913152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062067.371341:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:3622:x1875967130913152:12345-0@lo:400:kworker.0 Request processed in 36us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062067.371347:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789062067.371462:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130913664 00000100:00100000:2.0:1789062067.371466:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130913664 00000100:00100000:2.0:1789062067.371490:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130913792 00000100:00100000:2.0:1789062067.371493:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130913792 00000100:00100000:2.0:1789062067.371538:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130913408 00000100:00100000:2.0:1789062067.371543:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130913408 00000100:00100000:2.0:1789062067.371555:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130913920 00000100:00100000:2.0:1789062067.371557:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130913920 00000100:00100000:2.0:1789062067.371573:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789062067.371579:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130913664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062067.371634:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130913664:12345-0@lo:400:kworker.0 Request processed in 54us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062067.371640:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789062067.371654:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789062067.371661:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130913792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062067.371771:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130913792:12345-0@lo:400:kworker.0 Request processed in 110us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062067.371778:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789062067.371790:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789062067.371798:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130913408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062067.371854:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130913408:12345-0@lo:400:kworker.0 Request processed in 56us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062067.371860:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789062067.371874:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789062067.371880:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130913920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062067.371906:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130913920:12345-0@lo:400:kworker.0 Request processed in 27us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062067.371912:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789062067.371948:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c75d6d80 x1875967130913408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062067.371987:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130913408:0@lo:400:kworker.0 00010000:00080000:2.0:1789062067.372001:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c75d7100 x1875967130913920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062067.372009:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130913920:0@lo:400:kworker.0 00010000:00080000:2.0:1789062067.372040:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c75d7480 x1875967130913792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062067.372049:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130913792:0@lo:400:kworker.0 00000100:00100000:2.0:1789062067.372059:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130913152:0@lo:400:kworker.0 00010000:00080000:2.0:1789062067.372068:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c75d5f80 x1875967130913664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062067.372075:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130913664:0@lo:400:kworker.0 00000100:00100000:1.0:1789062067.372168:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130913536 00000100:00100000:1.0:1789062067.372173:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130913536 00000100:00100000:1.0:1789062067.372208:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789062067.372216:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130913536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062067.372254:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130913536:12345-0@lo:400:kworker.0 Request processed in 39us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062067.372260:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789062067.372352:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130913536:0@lo:400:kworker.0 00000100:00080000:0.0:1789062067.372660:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789062067.372667:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789062068.269758:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789062068.971328:0:17867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1789062069.043303:0:18986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789062069.290859:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789062070.033422:0:19038:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789062070.033782:0:19038:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789062070.313750:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789062070.940994:0:19088:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789062070.941283:0:19088:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789062071.082109:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789062056/real 1789062056] req@ffff9766c8172a00 x1875967130907520/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062071 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062071.082142:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766c8172a00 x1875967130907520/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062071 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062071.082152:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789062056/real 1789062056] req@ffff9766c8170e00 x1875967130907648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062071 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062071.082163:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766c8170e00 x1875967130907648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062071 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789062071.082181:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3160000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789062071.082216:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789062071.082221:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130907520:0@lo:8:kworker.0 00000100:00080000:0.0:1789062071.082226:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789062071.082231:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789062071.082234:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130907648:0@lo:8:kworker.0 00000100:00080000:2.0:1789062071.082524:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062071.082529:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789062071.082532:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062071.082535:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789062071.082549:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062071.082552:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789062071.082559:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3160000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789062071.082565:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1789062071.082569:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789062071.082581:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9767c3160000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062071.082601:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c748c700 x1875967130914560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789062071.082630:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062071.082633:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789062071.082635:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789062071.082638:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1789062071.082640:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789062071.082645:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9767c3f78000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062071.082659:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c7511500 x1875967130914688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789062071.082698:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130914432:0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.082760:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062071.082791:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789062071.082797:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83f5b9c6-643c-4659-afe5-bacf144ade05:3620:1875967130914048:0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.082840:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062071.082869:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130914816:0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.082892:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062071.082917:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130914176:0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.082950:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062071.082968:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130914944:0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.083001:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062071.083019:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789062071.083025:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130914304:0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.083046:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062071.083063:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130915072:0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.083383:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062071.083419:0:18432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130914432 00000100:00100000:2.0:1789062071.083427:0:18432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130914432 00000100:00100000:2.0:1789062071.083465:0:18432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130914176 00000100:00100000:2.0:1789062071.083469:0:18432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130914176 00000100:00100000:2.0:1789062071.083486:0:18432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789062071.083494:0:18432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130914432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.083545:0:18432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130914432:12345-0@lo:400:kworker.0 Request processed in 51us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062071.083551:0:18432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789062071.083568:0:18432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789062071.083574:0:18432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130914176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.083626:0:18432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130914176:12345-0@lo:400:kworker.0 Request processed in 31us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062071.083633:0:18432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789062071.083653:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130914048 00000100:00100000:2.0:1789062071.083657:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130914048 00000100:00100000:2.0:1789062071.083682:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789062071.083689:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+21:3620:x1875967130914048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.083718:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+21:3620:x1875967130914048:12345-0@lo:400:kworker.0 Request processed in 29us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062071.083736:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789062071.083763:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130914816 00000100:00100000:2.0:1789062071.083767:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130914816 00000100:00100000:2.0:1789062071.083781:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130914944 00000100:00100000:2.0:1789062071.083783:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130914944 00000100:00100000:2.0:1789062071.083801:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130914304 00000100:00100000:2.0:1789062071.083803:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130914304 00000100:00100000:2.0:1789062071.083813:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130915072 00000100:00100000:2.0:1789062071.083815:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130915072 00000100:00100000:2.0:1789062071.084848:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789062071.084858:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130914816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.084907:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130914816:12345-0@lo:400:kworker.0 Request processed in 51us (2014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062071.084913:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789062071.084927:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789062071.084945:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130914944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.084974:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130914944:12345-0@lo:400:kworker.0 Request processed in 42us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062071.084980:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789062071.084992:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789062071.084998:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130914304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.085023:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130914304:12345-0@lo:400:kworker.0 Request processed in 25us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062071.085030:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789062071.085042:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789062071.085047:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130915072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.085084:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130915072:12345-0@lo:400:kworker.0 Request processed in 37us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062071.085090:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789062071.085148:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83f5b9c6-643c-4659-afe5-bacf144ade05:3620:1875967130914048:0@lo:400:kworker.0 00010000:00080000:2.0:1789062071.085164:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7511180 x1875967130914816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062071.085174:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130914816:0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.085184:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130914432:0@lo:400:kworker.0 00010000:00080000:2.0:1789062071.085215:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c748ca80 x1875967130914304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062071.085223:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130914304:0@lo:400:kworker.0 00010000:00080000:2.0:1789062071.085233:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7513800 x1875967130915072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062071.085239:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130915072:0@lo:400:kworker.0 00000100:00100000:2.0:1789062071.085247:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130914176:0@lo:400:kworker.0 00010000:00080000:2.0:1789062071.085254:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7512680 x1875967130914944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062071.085260:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130914944:0@lo:400:kworker.0 00000100:00080000:0.0:1789062071.089464:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789062071.089476:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789062071.089500:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130914560:0@lo:8:kworker.0 00000100:00100000:0.0:1789062071.089570:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062071.089640:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130914688:0@lo:8:kworker.0 00000100:00100000:0.0:1789062071.089664:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062071.090962:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130914560 00000100:00100000:2.0:1789062071.090973:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130914560 00000100:00100000:2.0:1789062071.091009:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130914688 00000100:00100000:2.0:1789062071.091012:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130914688 00000100:00100000:2.0:1789062071.091038:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789062071.091045:0:18619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875967130914560:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789062071.091075:0:18619:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1789062071.091113:0:18619:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc7b2b 00002000:00100000:2.0:1789062071.091126:0:18619:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9766c8430800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789062071.091130:0:18619:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789062071.091133:0:18619:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789062071.091305:0:18619:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789062071.091439:0:18619:0:(import.c:65:import_set_state_nolock()) ffff9766c8432800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789062071.091505:0:18619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1875967130914560:12345-0@lo:8:kworker.0 Request processed in 459us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062071.091513:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789062071.091530:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789062071.091534:0:18619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875967130914688:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789062071.091546:0:18619:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789062071.092484:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c748c700 x1875967130914560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789062091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062071.092496:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789062071.092505:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789062071.092513:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789062071.092518:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789062071.092521:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3160000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789062071.092541:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789062071.092548:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130914560:0@lo:8:kworker.0 00000004:00080000:0.0:1789062071.092654:0:17855:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789062071.092742:0:17855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 452202134684ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789062071.092748:0:17855:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789062071.092802:0:17856:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789062071.097053:0:17856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1875967130915328:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789062071.097156:0:17856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062071.097183:0:17856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789062071.097356:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789062071.097376:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130915200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789062071.097405:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062071.097591:0:18622:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789062071.097600:0:18622:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789062071.098119:0:18621:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789062071.098132:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130915328 00000100:00100000:3.0:1789062071.098140:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130915328 00000100:00100000:3.0:1789062071.098203:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130915200 00000100:00100000:3.0:1789062071.098207:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130915200 00000100:00100000:3.0:1789062071.098237:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789062071.098246:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3621:x1875967130915200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789062071.098273:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789062071.098338:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3621:x1875967130915200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062071.098345:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789062071.098453:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789062071.099889:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c81ab480 x1875967130915200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789062087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062071.099915:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130915200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789062071.100744:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789062071.100756:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17856:x1875967130915328:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:1.0:1789062071.104646:0:19096:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789062071.104655:0:19096:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789062071.104753:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17856:x1875967130915328:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3997us (7596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062071.104764:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789062071.104872:0:17856:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c81a9f80 x1875967130915328/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789062087 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062071.104889:0:17856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1875967130915328:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789062071.104902:0:17856:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789062071.108016:0:17856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1875967130915456:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789062071.108093:0:17856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062071.108136:0:17856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062071.110012:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130915456 00000100:00100000:1.0:1789062071.110024:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130915456 00000100:00100000:1.0:1789062071.110081:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789062071.110092:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17856:x1875967130915456:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789062071.110123:0:18621:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789062071.110194:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17856:x1875967130915456:12345-0@lo:5:osp-pre-0-1.0 Request processed in 104us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062071.110201:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789062071.110691:0:17856:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c81a9f80 x1875967130915456/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789062087 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062071.110707:0:17856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1875967130915456:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789062071.110722:0:17856:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789062071.110764:0:17856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1875967130915584:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789062071.110799:0:17856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062071.110821:0:17856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d0247300 going to sleep for 11 seconds 00000100:00100000:1.0:1789062071.110838:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130915584 00000100:00100000:1.0:1789062071.110842:0:19096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130915584 00000100:00100000:1.0:1789062071.110871:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789062071.110878:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17856:x1875967130915584:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789062071.110903:0:18621:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:3.0:1789062071.114163:0:17847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789062071.125121:0:18619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875967130914688:12345-0@lo:8:kworker.0 Request processed in 33577us (35448us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789062071.125133:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789062071.127828:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789062071.127838:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789062071.127842:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130914688:0@lo:8:kworker.0 00000001:00080000:1.0:1789062071.137696:0:18616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789062071.137712:0:18616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789062071.138163:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17856:x1875967130915584:12345-0@lo:5:osp-pre-0-1.0 Request processed in 27281us (27359us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789062071.138177:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789062071.138269:0:17856:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c75d4000 x1875967130915584/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789062087 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062071.138288:0:17856:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789062071.138295:0:17856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1875967130915584:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789062071.138371:0:17856:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1789062071.138425:0:17856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17856:1875967130915712:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789062071.138463:0:17856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062071.139042:0:17856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d0247300 going to sleep for 11 seconds 00000100:00100000:0.0:1789062071.146834:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130915712 00000100:00100000:0.0:1789062071.146848:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130915712 00000100:00100000:0.0:1789062071.146902:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789062071.146912:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17856:x1875967130915712:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789062071.147016:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17856:x1875967130915712:12345-0@lo:900:osp-pre-0-1.0 Request processed in 106us (8552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062071.147024:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789062071.147079:0:17856:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c75d4000 x1875967130915712/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789062087 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062071.147094:0:17856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17856:1875967130915712:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1789062071.338029:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062071.978488:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130915968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789062071.978587:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062071.978887:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130915840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789062071.978922:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062071.979267:0:18432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130915968 00000100:00100000:2.0:1789062071.979276:0:18432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130915968 00000100:00100000:0.0:1789062071.979482:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130915840 00000100:00100000:0.0:1789062071.979487:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130915840 00000100:00100000:0.0:1789062071.979538:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789062071.979550:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130915840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789062071.979593:0:17121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789062071.979676:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130915840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062071.979684:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789062071.979838:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130915840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789062071.982981:0:18432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789062071.983013:0:18432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130915968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789062071.983085:0:18432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789062071.983518:0:18432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130915968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 521us (4930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062071.983526:0:18432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789062071.983696:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130915968:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789062072.362739:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062073.390415:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062074.410952:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789062074.863670:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789062075.441622:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062076.458438:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789062076.589786:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062076.589792:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789062076.589795:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789062076.589795:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130916096:0@lo:400:kworker.0 00000100:00080000:2.0:1789062076.589798:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789062076.589815:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062076.589818:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789062076.589821:0:8:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789062076.589826:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 452 00000100:00080000:2.0:1789062076.589831:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789062076.589840:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9767c3f78000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062076.589860:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c7510000 x1875967130916736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789062076.589865:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062076.589927:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130916608:0@lo:400:kworker.0 00000100:00100000:0.0:1789062076.589952:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062076.589972:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789062076.589977:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130916480:0@lo:400:kworker.0 00000100:00100000:0.0:1789062076.589999:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062076.590017:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130917120:0@lo:400:kworker.0 00000100:00100000:2.0:1789062076.590022:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130916736:0@lo:8:kworker.0 00000100:00100000:0.0:1789062076.590043:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062076.590046:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062076.590069:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130916224:0@lo:400:kworker.0 00000100:00100000:0.0:1789062076.590105:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062076.590130:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130916864:0@lo:400:kworker.0 00000100:00100000:0.0:1789062076.590150:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062076.590167:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789062076.590172:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130916352:0@lo:400:kworker.0 00000100:00100000:0.0:1789062076.590191:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062076.590206:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130916992:0@lo:400:kworker.0 00000100:00100000:0.0:1789062076.590227:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062076.590251:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130916096 00000100:00100000:0.0:1789062076.590258:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130916096 00000100:00100000:0.0:1789062076.590297:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789062076.590316:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+21:3623:x1875967130916096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062076.590330:0:18432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130916480 00000100:00100000:2.0:1789062076.590333:0:18432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130916480 00000100:00100000:2.0:1789062076.590358:0:18432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130916224 00000100:00100000:0.0:1789062076.590359:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+21:3623:x1875967130916096:12345-0@lo:400:kworker.0 Request processed in 55us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062076.590360:0:18432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130916224 00000100:00100000:0.0:1789062076.590366:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789062076.590372:0:18432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789062076.590377:0:18432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130916480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062076.590395:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130916608 00000100:00100000:0.0:1789062076.590398:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130916608 00000100:00100000:2.0:1789062076.590417:0:18432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130916480:12345-0@lo:400:kworker.0 Request processed in 39us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062076.590423:0:18432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789062076.590436:0:18432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789062076.590439:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130916736 00000100:00100000:2.0:1789062076.590441:0:18432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130916224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062076.590441:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130916736 00000100:00100000:0.0:1789062076.590455:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789062076.590461:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130916608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062076.590482:0:18432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130916224:12345-0@lo:400:kworker.0 Request processed in 40us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062076.590488:0:18432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789062076.590488:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130916608:12345-0@lo:400:kworker.0 Request processed in 28us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062076.590493:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789062076.590503:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789062076.590507:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875967130916736:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789062076.590532:0:18622:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789062076.594603:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789062076.594639:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130917248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789062076.594700:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062076.595568:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130917248 00000100:00100000:1.0:1789062076.595578:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130917248 00000100:00100000:1.0:1789062076.595638:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789062076.595647:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130917248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789062076.595675:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789062076.595727:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130917248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062076.595734:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789062076.595930:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c75d4000 x1875967130917248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789062092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062076.595957:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130917248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789062076.596905:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130917120 00000100:00100000:1.0:1789062076.596913:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130917120 00000100:00100000:1.0:1789062076.596947:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130916864 00000100:00100000:1.0:1789062076.596950:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130916864 00000100:00100000:1.0:1789062076.596977:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130916352 00000100:00100000:1.0:1789062076.596980:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130916352 00000100:00100000:1.0:1789062076.596990:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130916992 00000100:00100000:1.0:1789062076.596992:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130916992 00000100:00100000:1.0:1789062076.597008:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789062076.597016:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130917120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062076.597067:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130917120:12345-0@lo:400:kworker.0 Request processed in 52us (7024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062076.597074:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789062076.597088:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789062076.597093:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130916864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062076.597119:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130916864:12345-0@lo:400:kworker.0 Request processed in 26us (6968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062076.597125:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789062076.597137:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789062076.597142:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130916352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062076.597164:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875967130916352:12345-0@lo:400:kworker.0 Request processed in 23us (6973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062076.597169:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789062076.597179:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789062076.597184:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130916992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062076.597209:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875967130916992:12345-0@lo:400:kworker.0 Request processed in 25us (6981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062076.597214:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789062076.599666:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789062076.599674:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789062076.599676:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789062076.599695:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7513800 x1875967130916352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062076.599711:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875967130916352:0@lo:400:kworker.0 00000100:00100000:1.0:1789062076.599714:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130916480:0@lo:400:kworker.0 00010000:00080000:2.0:1789062076.599722:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7511880 x1875967130916992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789062076.599726:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7513b80 x1875967130917120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062076.599731:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875967130916992:0@lo:400:kworker.0 00000100:00100000:1.0:1789062076.599735:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130917120:0@lo:400:kworker.0 00000100:00100000:2.0:1789062076.599741:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130916224:0@lo:400:kworker.0 00010000:00080000:1.0:1789062076.599743:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7512300 x1875967130916608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789062092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789062076.599750:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7513100 x1875967130916864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062076.599751:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130916608:0@lo:400:kworker.0 00000100:00100000:1.0:1789062076.599759:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130916096:0@lo:400:kworker.0 00000100:00100000:2.0:1789062076.599768:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130916864:0@lo:400:kworker.0 00000100:00100000:2.0:1789062076.619864:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875967130916736:12345-0@lo:8:kworker.0 Request processed in 29347us (29808us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789062076.619879:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789062076.620649:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062076.620657:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789062076.620662:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130916736:0@lo:8:kworker.0 00000100:00100000:0.0:1789062077.106684:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789062077.106707:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130917376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789062077.106770:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062077.107545:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130917504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789062077.107585:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062077.107683:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130917376 00000100:00100000:3.0:1789062077.107691:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130917376 00000100:00100000:3.0:1789062077.107733:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130917504 00000100:00100000:3.0:1789062077.107737:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130917504 00000100:00100000:3.0:1789062077.107754:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789062077.107764:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130917376:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789062077.108202:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789062077.108212:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130917504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789062077.108231:0:17121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789062077.108394:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130917504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 184us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062077.108401:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789062077.108444:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130917504:0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789062077.108486:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789062077.108533:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130917376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 771us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062077.108539:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789062077.108601:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130917376:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789062077.481707:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062077.610723:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789062057/real 1789062057] req@ffff9766c8172d80 x1875967130908032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062077 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062077.610752:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766c8172d80 x1875967130908032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062077 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062077.610762:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789062057/real 1789062057] req@ffff9766c8173800 x1875967130908160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062077 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062077.610773:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766c8173800 x1875967130908160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789062077 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789062077.610791:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f63000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062077.610806:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789062077.610810:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130908032:0@lo:8:kworker.0 00000100:00080000:1.0:1789062077.610826:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062077.610832:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789062077.610834:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130908160:0@lo:8:kworker.0 00000100:00080000:2.0:1789062077.612155:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062077.612161:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789062077.612163:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f63000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1789062077.612166:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130917632:0@lo:400:kworker.0 00000100:00100000:1.0:1789062077.612231:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062077.612325:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130917632 00000100:00100000:3.0:1789062077.612333:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130917632 00000100:00100000:3.0:1789062077.612393:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789062077.612409:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:3622:x1875967130917632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062077.612468:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:3622:x1875967130917632:12345-0@lo:400:kworker.0 Request processed in 60us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062077.612475:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789062077.612536:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130917632:0@lo:400:kworker.0 00000100:00080000:2.0:1789062077.612651:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:2.0:1789062077.612655:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789062077.612662:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9767c3f63000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062077.612685:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c7512680 x1875967130917760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789062077.612705:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062077.612709:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789062077.612711:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789062077.612714:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:2.0:1789062077.612717:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789062077.612722:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9767c3f65800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062077.612731:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130917760:0@lo:8:kworker.0 00000100:00100000:2.0:1789062077.612733:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c7511880 x1875967130917888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789062077.612761:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789062077.612766:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062077.612769:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789062077.612771:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789062077.612774:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1789062077.612782:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789062077.612787:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9767c3f78000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062077.612787:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130917888:0@lo:8:kworker.0 00000100:00100000:2.0:1789062077.612799:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c7513100 x1875967130918272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789062077.612806:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062077.612823:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130918272:0@lo:8:kworker.0 00000100:00100000:2.0:1789062077.612836:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130918400:0@lo:400:kworker.0 00000100:00100000:1.0:1789062077.612842:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062077.612862:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062077.612867:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130917760 00000100:00100000:1.0:1789062077.612871:0:19096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130917760 00000100:00100000:2.0:1789062077.613066:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789062077.613072:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130918144:0@lo:400:kworker.0 00000100:00100000:2.0:1789062077.613096:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062077.613120:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130917888 00000100:00100000:2.0:1789062077.613124:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130917888 00000100:00100000:1.0:1789062077.613279:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130918272 00000100:00100000:2.0:1789062077.613307:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130918144 00000100:00100000:2.0:1789062077.613311:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130918144 00000100:00100000:2.0:1789062077.613330:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789062077.613336:0:18619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130918144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062077.613350:0:19096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130918272 00000100:00100000:1.0:1789062077.613365:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789062077.613370:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3619:x1875967130917760:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789062077.613394:0:19096:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:1.0:1789062077.613421:0:19096:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc7b32 00002000:00100000:1.0:1789062077.613433:0:19096:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9767c2a60000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789062077.613437:0:19096:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789062077.613440:0:19096:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789062077.613474:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130918016:0@lo:400:kworker.0 00000100:00100000:3.0:1789062077.613501:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1789062077.613506:0:19096:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1789062077.613520:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130918656:0@lo:400:kworker.0 00000100:00080000:1.0:1789062077.613533:0:19096:0:(import.c:65:import_set_state_nolock()) ffff9767c2a67800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789062077.613537:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062077.613552:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789062077.613558:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130918528:0@lo:400:kworker.0 00000100:00100000:1.0:1789062077.613567:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3619:x1875967130917760:12345-0@lo:8:kworker.0 Request processed in 196us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062077.613574:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789062077.613579:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062077.613588:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789062077.613623:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3619:x1875967130917888:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789062077.613634:0:19096:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789062077.613641:0:18621:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1789062077.613648:0:18621:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1789062077.613659:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3619:x1875967130917888:12345-0@lo:8:kworker.0 Request processed in 66us (852us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789062077.613665:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789062077.613677:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789062077.613681:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3619:x1875967130918272:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789062077.613691:0:19096:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789062077.613711:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3619:x1875967130918272:12345-0@lo:8:kworker.0 Request processed in 30us (869us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789062077.613716:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789062077.613730:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130918400 00000100:00100000:1.0:1789062077.613733:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130918400 00000100:00100000:1.0:1789062077.613750:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130918016 00000100:00100000:1.0:1789062077.613752:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130918016 00000100:00100000:1.0:1789062077.613761:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130918656 00000100:00100000:1.0:1789062077.613763:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130918656 00000100:00100000:1.0:1789062077.613772:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130918528 00000100:00100000:1.0:1789062077.613774:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130918528 00000100:00100000:1.0:1789062077.613783:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789062077.613789:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130918400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062077.616475:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130918400:12345-0@lo:400:kworker.0 Request processed in 2675us (3602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062077.616495:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789062077.616531:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789062077.616542:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130918016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062077.616847:0:18619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130918144:12345-0@lo:400:kworker.0 Request processed in 3509us (3749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062077.616857:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789062077.617726:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130918016:12345-0@lo:400:kworker.0 Request processed in 1184us (4221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062077.617735:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789062077.617758:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789062077.617768:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130918656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062077.617812:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130918656:12345-0@lo:400:kworker.0 Request processed in 48us (4274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062077.617818:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789062077.617828:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789062077.617834:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130918528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062077.617856:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130918528:12345-0@lo:400:kworker.0 Request processed in 23us (4275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062077.617861:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789062077.617975:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7513800 x1875967130918016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062077.617990:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130918016:0@lo:400:kworker.0 00010000:00080000:2.0:1789062077.618001:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7512300 x1875967130918656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062077.618009:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130918656:0@lo:400:kworker.0 00010000:00080000:2.0:1789062077.618032:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7511500 x1875967130918528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062077.618047:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130918528:0@lo:400:kworker.0 00000100:00080000:1.0:1789062077.618102:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062077.618107:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789062077.618110:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130918272:0@lo:8:kworker.0 00000100:00080000:1.0:1789062077.618119:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062077.618123:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789062077.618126:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130917888:0@lo:8:kworker.0 00010000:00080000:1.0:1789062077.618500:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7512680 x1875967130917760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789062102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062077.618522:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789062077.618530:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789062077.618538:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789062077.618543:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789062077.618546:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f63000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789062077.618634:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789062077.618640:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130917760:0@lo:8:kworker.0 00000100:00100000:1.0:1789062077.618828:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130918784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789062077.618872:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789062077.618986:0:17140:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1789062077.619007:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7512300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17140:1875967130918912:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789062077.619034:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062077.619052:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6750c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789062077.619079:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130918912 00000100:00100000:2.0:1789062077.619086:0:19096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130918912 00000100:00100000:2.0:1789062077.619205:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789062077.619216:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17140:x1875967130918912:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:3.0:1789062077.619581:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7510700 x1875967130918144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789062093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789062077.619643:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130918144:0@lo:400:kworker.0 00010000:00080000:3.0:1789062077.619661:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7510000 x1875967130918400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789062077.619669:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130918400:0@lo:400:kworker.0 00000004:00080000:3.0:1789062077.619767:0:17139:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789062077.619847:0:17139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 458729240556ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789062077.619855:0:17139:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789062077.620064:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130918784 00000100:00100000:1.0:1789062077.620070:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130918784 00000100:00100000:1.0:1789062077.620306:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789062077.620316:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875967130918784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789062077.620333:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789062077.620396:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875967130918784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062077.620403:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789062077.620697:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789062077.620844:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7511500 x1875967130918784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789062093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062077.620861:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130918784:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789062077.623288:0:17095:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1789062077.624022:0:19096:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789062077.624032:0:19096:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789062077.624038:0:19096:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:0.0:1789062077.640151:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789062077.640163:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003497756/0x2774d8f311dc7b39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.640181:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1789062077.640186:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789062077.640192:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003497756/0x2774d8f311dc7b39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.640210:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003497756/0x2774d8f311dc7b39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.640228:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003497756/0x2774d8f311dc7b39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.640236:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003497756/0x2774d8f311dc7b39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.640258:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789062077.640424:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789062077.640432:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003497756/0x2774d8f311dc7b39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.640440:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199c00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062077.640444:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003497756/0x2774d8f311dc7b39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.640453:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003497756/0x2774d8f311dc7b39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.640471:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003497756/0x2774d8f311dc7b39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.640490:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003497756/0x2774d8f311dc7b39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.640509:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062077.640511:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062077.640513:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789062077.641711:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789062077.641719:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc7b40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.641730:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1789062077.641734:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789062077.641739:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc7b40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.641750:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc7b40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.641760:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc7b40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.641768:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc7b40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.641800:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789062077.641867:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789062077.641883:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc7b40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.641910:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199000 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789062077.641914:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc7b40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.641922:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc7b40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.641940:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc7b40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.641948:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da9e16e3/0x2774d8f311dc7b40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.641965:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.641966:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.641968:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789062077.645281:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789062077.645719:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7b47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.645735:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1789062077.645740:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789062077.645745:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7b47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.645759:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7b47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.645768:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7b47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.645777:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7b47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.645804:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789062077.645848:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789062077.645855:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7b47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.645873:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8199200 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789062077.645878:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7b47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.645896:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7b47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.645915:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7b47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.645922:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf4b15b0/0x2774d8f311dc7b47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.645943:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062077.645945:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062077.645946:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789062077.647337:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789062077.647346:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000480ceb8f/0x2774d8f311dc7b4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.647360:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1789062077.647363:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789062077.647369:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000480ceb8f/0x2774d8f311dc7b4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.647381:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000480ceb8f/0x2774d8f311dc7b4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.647399:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000480ceb8f/0x2774d8f311dc7b4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.647407:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000480ceb8f/0x2774d8f311dc7b4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.647428:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789062077.647757:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789062077.647764:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000480ceb8f/0x2774d8f311dc7b4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.647772:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47be00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789062077.647776:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000480ceb8f/0x2774d8f311dc7b4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.647795:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000480ceb8f/0x2774d8f311dc7b4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.647818:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000480ceb8f/0x2774d8f311dc7b4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.647825:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000480ceb8f/0x2774d8f311dc7b4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.647842:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.647844:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.647845:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789062077.648013:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789062077.648018:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc7b55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.648027:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1789062077.648030:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789062077.648034:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc7b55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.648044:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc7b55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.648052:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc7b55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.648059:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc7b55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.648093:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789062077.648545:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789062077.648552:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba0be641/0x2774d8f311dc7b5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.648560:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1789062077.648563:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789062077.648567:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba0be641/0x2774d8f311dc7b5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.648575:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba0be641/0x2774d8f311dc7b5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.648582:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba0be641/0x2774d8f311dc7b5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.648589:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba0be641/0x2774d8f311dc7b5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.648715:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789062077.649357:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789062077.649365:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7b63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.649375:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1789062077.649385:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789062077.649390:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7b63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.649400:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7b63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.649408:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7b63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.649415:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7b63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649440:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789062077.649447:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc7b55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649454:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ba00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.649465:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc7b55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649474:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc7b55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649489:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc7b55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649496:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000089571b5/0x2774d8f311dc7b55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649512:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789062077.649515:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba0be641/0x2774d8f311dc7b5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649521:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b400 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.649524:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba0be641/0x2774d8f311dc7b5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649532:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba0be641/0x2774d8f311dc7b5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649541:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba0be641/0x2774d8f311dc7b5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649548:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba0be641/0x2774d8f311dc7b5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649566:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.649569:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7b63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649576:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a400 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.649579:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7b63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649585:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7b63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649595:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7b63 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.649602:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.649627:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.649630:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.649919:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062077.650007:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789062077.650013:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7b63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.650356:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789062077.650596:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789062077.650697:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000370fcb55/0x2774d8f311dc7b6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.650709:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1789062077.650713:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789062077.650717:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000370fcb55/0x2774d8f311dc7b6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.650727:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000370fcb55/0x2774d8f311dc7b6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.650742:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000370fcb55/0x2774d8f311dc7b6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.650749:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000370fcb55/0x2774d8f311dc7b6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.651349:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789062077.651630:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789062077.651637:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000370fcb55/0x2774d8f311dc7b6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.651646:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47aa00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789062077.651650:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000370fcb55/0x2774d8f311dc7b6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.651658:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000370fcb55/0x2774d8f311dc7b6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.651673:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000370fcb55/0x2774d8f311dc7b6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.651679:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000370fcb55/0x2774d8f311dc7b6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.651707:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.651709:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.651710:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789062077.651931:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789062077.651938:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc7b71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.651948:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1789062077.651951:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789062077.651956:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc7b71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.651965:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc7b71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.651974:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc7b71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.651981:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc7b71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.652092:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789062077.652990:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.652997:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc7b71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.653010:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.653014:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc7b71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.653036:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc7b71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.653053:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc7b71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.653060:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdadce1f/0x2774d8f311dc7b71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.653078:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.653079:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.653081:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789062077.653492:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062077.653499:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b155fa25/0x2774d8f311dc7b78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.653509:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789062077.653513:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062077.653517:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b155fa25/0x2774d8f311dc7b78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.653527:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b155fa25/0x2774d8f311dc7b78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.653535:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b155fa25/0x2774d8f311dc7b78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.653541:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b155fa25/0x2774d8f311dc7b78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.653562:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789062077.653783:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789062077.653789:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b155fa25/0x2774d8f311dc7b78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.653797:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789062077.653800:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b155fa25/0x2774d8f311dc7b78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.653808:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b155fa25/0x2774d8f311dc7b78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.653821:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b155fa25/0x2774d8f311dc7b78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.653829:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b155fa25/0x2774d8f311dc7b78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.653843:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.653844:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.653846:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789062077.654056:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062077.654068:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095d62a6d/0x2774d8f311dc7b7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.654076:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789062077.654079:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062077.654083:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095d62a6d/0x2774d8f311dc7b7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.654092:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095d62a6d/0x2774d8f311dc7b7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.654100:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095d62a6d/0x2774d8f311dc7b7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.654107:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095d62a6d/0x2774d8f311dc7b7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.654127:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789062077.654160:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.654173:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095d62a6d/0x2774d8f311dc7b7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.654181:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483a00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.654185:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095d62a6d/0x2774d8f311dc7b7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.654193:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095d62a6d/0x2774d8f311dc7b7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.654204:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095d62a6d/0x2774d8f311dc7b7f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.654222:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095d62a6d/0x2774d8f311dc7b7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.654236:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.654238:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.654239:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789062077.654840:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062077.654846:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b348ff84/0x2774d8f311dc7b86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.654855:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1789062077.654859:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062077.654863:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b348ff84/0x2774d8f311dc7b86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.654874:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b348ff84/0x2774d8f311dc7b86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.654898:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b348ff84/0x2774d8f311dc7b86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062077.654906:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b348ff84/0x2774d8f311dc7b86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.655366:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789062077.655758:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062077.655765:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7b8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.655791:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789062077.655795:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062077.655800:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7b8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.655810:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7b8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.655820:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7b8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.655827:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7b8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.655881:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789062077.655896:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b348ff84/0x2774d8f311dc7b86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.655904:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483c00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.655908:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b348ff84/0x2774d8f311dc7b86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.655916:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b348ff84/0x2774d8f311dc7b86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.655931:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b348ff84/0x2774d8f311dc7b86 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.655939:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b348ff84/0x2774d8f311dc7b86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.655954:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.655957:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7b8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.655969:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b400 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.655973:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7b8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.655981:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7b8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.655992:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7b8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.656000:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.656002:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.656004:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.656495:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789062077.656500:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7b8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.656684:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789062077.656989:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062077.656995:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9563c3a/0x2774d8f311dc7b94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.657004:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789062077.657007:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062077.657011:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9563c3a/0x2774d8f311dc7b94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.657032:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9563c3a/0x2774d8f311dc7b94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.657041:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9563c3a/0x2774d8f311dc7b94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.657048:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9563c3a/0x2774d8f311dc7b94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.657097:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789062077.657579:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062077.657585:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b7845bf/0x2774d8f311dc7b9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.657595:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789062077.657598:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062077.657602:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b7845bf/0x2774d8f311dc7b9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.657634:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b7845bf/0x2774d8f311dc7b9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.657643:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b7845bf/0x2774d8f311dc7b9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.657660:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b7845bf/0x2774d8f311dc7b9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.657866:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789062077.657874:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9563c3a/0x2774d8f311dc7b94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.657882:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807ae00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.657899:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9563c3a/0x2774d8f311dc7b94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.657909:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9563c3a/0x2774d8f311dc7b94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.657925:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9563c3a/0x2774d8f311dc7b94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.657938:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9563c3a/0x2774d8f311dc7b94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.657953:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.657957:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b7845bf/0x2774d8f311dc7b9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.657964:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807bc00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.657967:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b7845bf/0x2774d8f311dc7b9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.657975:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b7845bf/0x2774d8f311dc7b9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.657986:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b7845bf/0x2774d8f311dc7b9b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.657993:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.657995:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.657997:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.658059:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789062077.658065:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b7845bf/0x2774d8f311dc7b9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789062077.658664:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062077.658670:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc7ba2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.658680:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789062077.658683:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062077.658687:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc7ba2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.658696:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc7ba2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.658705:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc7ba2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.658713:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc7ba2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.659452:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.659461:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc7ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.659470:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.659482:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc7ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.659491:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc7ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.659508:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc7ba2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.659517:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.659519:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.659520:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.659597:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789062077.659603:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005921a600/0x2774d8f311dc7ba2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789062077.660380:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062077.660387:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e671ba4a/0x2774d8f311dc7ba9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.660398:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789062077.660403:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062077.660408:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e671ba4a/0x2774d8f311dc7ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.660420:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e671ba4a/0x2774d8f311dc7ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.660429:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e671ba4a/0x2774d8f311dc7ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.660436:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e671ba4a/0x2774d8f311dc7ba9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.660487:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.660493:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e671ba4a/0x2774d8f311dc7ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.660502:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807aa00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.660505:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e671ba4a/0x2774d8f311dc7ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.660513:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e671ba4a/0x2774d8f311dc7ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.660525:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e671ba4a/0x2774d8f311dc7ba9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.660534:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.660542:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.660544:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.660630:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789062077.660635:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e671ba4a/0x2774d8f311dc7ba9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789062077.661057:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062077.661064:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a2595a/0x2774d8f311dc7bb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.661074:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789062077.661077:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062077.661081:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a2595a/0x2774d8f311dc7bb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.661090:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a2595a/0x2774d8f311dc7bb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.661099:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a2595a/0x2774d8f311dc7bb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.661105:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a2595a/0x2774d8f311dc7bb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.661162:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.661373:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a2595a/0x2774d8f311dc7bb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.661380:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807ac00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.661384:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a2595a/0x2774d8f311dc7bb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.661391:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a2595a/0x2774d8f311dc7bb0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.661404:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a2595a/0x2774d8f311dc7bb0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.661412:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.661414:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.661416:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.661479:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789062077.661484:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a2595a/0x2774d8f311dc7bb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789062077.661960:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062077.661967:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2625fe7/0x2774d8f311dc7bb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.661986:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789062077.661989:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062077.661994:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2625fe7/0x2774d8f311dc7bb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.662003:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2625fe7/0x2774d8f311dc7bb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.662011:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2625fe7/0x2774d8f311dc7bb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.662017:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2625fe7/0x2774d8f311dc7bb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.662058:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.662063:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2625fe7/0x2774d8f311dc7bb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.662071:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.662075:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2625fe7/0x2774d8f311dc7bb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.662081:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2625fe7/0x2774d8f311dc7bb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.662099:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2625fe7/0x2774d8f311dc7bb7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.662107:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.662108:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.662110:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.662420:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789062077.662426:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2625fe7/0x2774d8f311dc7bb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789062077.662836:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062077.662842:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7bbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.662851:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789062077.662854:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062077.662858:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7bbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.662881:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7bbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.662899:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7bbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.662907:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7bbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.663048:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.663054:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7bbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.663061:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b400 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.663065:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7bbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.663073:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7bbe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.663085:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7bbe lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.663093:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.663094:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.663096:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.663370:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789062077.663376:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e367a6d/0x2774d8f311dc7bbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789062077.663715:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062077.663721:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc725225/0x2774d8f311dc7bc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.663730:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789062077.663733:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062077.663738:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc725225/0x2774d8f311dc7bc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.663747:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc725225/0x2774d8f311dc7bc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.663766:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc725225/0x2774d8f311dc7bc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.663773:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc725225/0x2774d8f311dc7bc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.663975:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.663981:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc725225/0x2774d8f311dc7bc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.663997:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b200 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.664001:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc725225/0x2774d8f311dc7bc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.664010:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc725225/0x2774d8f311dc7bc5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.664022:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc725225/0x2774d8f311dc7bc5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.664029:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.664030:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.664032:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062077.664060:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789062077.664064:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc725225/0x2774d8f311dc7bc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.664381:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789062077.664503:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062077.664508:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f035b8ec/0x2774d8f311dc7bcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.664517:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=458s v=(0 0) 00010000:00010000:3.0:1789062077.664521:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062077.664525:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f035b8ec/0x2774d8f311dc7bcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.664534:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f035b8ec/0x2774d8f311dc7bcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.664542:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f035b8ec/0x2774d8f311dc7bcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.664561:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f035b8ec/0x2774d8f311dc7bcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062077.664579:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789062077.665289:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.665296:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f035b8ec/0x2774d8f311dc7bcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.665304:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a000 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.665308:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f035b8ec/0x2774d8f311dc7bcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.665317:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f035b8ec/0x2774d8f311dc7bcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.665330:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f035b8ec/0x2774d8f311dc7bcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.665345:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f035b8ec/0x2774d8f311dc7bcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.665362:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.665363:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.665365:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789062077.666007:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789062077.666015:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7bd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.666026:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1789062077.666030:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789062077.666035:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.666045:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.666054:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.666061:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.666077:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789062077.666534:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789062077.666539:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9b98a85/0x2774d8f311dc7bda lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.666547:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1789062077.666556:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789062077.666560:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9b98a85/0x2774d8f311dc7bda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.666568:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9b98a85/0x2774d8f311dc7bda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.666575:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9b98a85/0x2774d8f311dc7bda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.666581:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9b98a85/0x2774d8f311dc7bda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.666593:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789062077.666962:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789062077.666968:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.666977:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a400 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.666981:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.666989:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7bd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.667002:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7bd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.667009:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb08d268/0x2774d8f311dc7bd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.667039:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.667043:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9b98a85/0x2774d8f311dc7bda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.667057:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a200 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.667060:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9b98a85/0x2774d8f311dc7bda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.667068:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9b98a85/0x2774d8f311dc7bda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.667079:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9b98a85/0x2774d8f311dc7bda lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.667086:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9b98a85/0x2774d8f311dc7bda lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.667098:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.667100:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.667101:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.667109:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789062077.667959:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789062077.667967:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a850b8c/0x2774d8f311dc7be1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.667978:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1789062077.667982:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789062077.667988:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a850b8c/0x2774d8f311dc7be1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.667998:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a850b8c/0x2774d8f311dc7be1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.668006:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a850b8c/0x2774d8f311dc7be1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.668019:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a850b8c/0x2774d8f311dc7be1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.668038:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789062077.669139:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789062077.669298:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.669307:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a850b8c/0x2774d8f311dc7be1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.669316:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47bc00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.669321:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a850b8c/0x2774d8f311dc7be1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.669332:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a850b8c/0x2774d8f311dc7be1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.669356:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a850b8c/0x2774d8f311dc7be1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.669363:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a850b8c/0x2774d8f311dc7be1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.669379:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.669381:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.669383:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062077.669453:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7f5636b/0x2774d8f311dc7be8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.669463:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1789062077.669466:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789062077.669472:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f5636b/0x2774d8f311dc7be8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.669482:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7f5636b/0x2774d8f311dc7be8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.669491:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7f5636b/0x2774d8f311dc7be8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.669497:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f5636b/0x2774d8f311dc7be8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.669520:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789062077.670008:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.670014:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7f5636b/0x2774d8f311dc7be8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.670022:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ae00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.670026:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7f5636b/0x2774d8f311dc7be8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.670034:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7f5636b/0x2774d8f311dc7be8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.670046:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7f5636b/0x2774d8f311dc7be8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.670054:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7f5636b/0x2774d8f311dc7be8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.670078:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.670080:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.670082:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789062077.670437:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789062077.670443:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9fecfd8/0x2774d8f311dc7bef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.670460:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1789062077.670463:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789062077.670467:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9fecfd8/0x2774d8f311dc7bef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.670476:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9fecfd8/0x2774d8f311dc7bef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.670484:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9fecfd8/0x2774d8f311dc7bef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.670491:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9fecfd8/0x2774d8f311dc7bef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.670511:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789062077.671398:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.671406:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9fecfd8/0x2774d8f311dc7bef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.671416:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.671421:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9fecfd8/0x2774d8f311dc7bef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.671429:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9fecfd8/0x2774d8f311dc7bef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.671442:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9fecfd8/0x2774d8f311dc7bef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.671450:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9fecfd8/0x2774d8f311dc7bef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.671466:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.671468:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.671469:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789062077.671709:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789062077.671716:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001291cf85/0x2774d8f311dc7bf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.671724:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1789062077.671728:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789062077.671733:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001291cf85/0x2774d8f311dc7bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.671743:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001291cf85/0x2774d8f311dc7bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.671763:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001291cf85/0x2774d8f311dc7bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.671771:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001291cf85/0x2774d8f311dc7bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062077.672437:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789062077.672503:0:19096:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1789062077.672583:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17140:x1875967130918912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 53366us (53544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062077.672593:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789062077.672741:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7512300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17140:1875967130918912:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789062077.672756:0:17140:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1789062077.672876:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7512300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17140:1875967130919040:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789062077.672923:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062077.672953:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6750c00 going to sleep for 11 seconds 00010000:00010000:0.0:1789062077.673013:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062077.673019:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001291cf85/0x2774d8f311dc7bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.673042:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b200 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062077.673046:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001291cf85/0x2774d8f311dc7bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.673055:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001291cf85/0x2774d8f311dc7bf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.673069:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001291cf85/0x2774d8f311dc7bf6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.673076:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001291cf85/0x2774d8f311dc7bf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062077.673094:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.673095:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062077.673097:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062077.673906:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130919040 00000100:00100000:1.0:1789062077.673916:0:19396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130919040 00000100:00100000:1.0:1789062077.673965:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789062077.673974:0:19396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17140:x1875967130919040:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789062077.674014:0:19396:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:1.0:1789062077.683500:0:18616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1789062077.683546:0:18616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789062077.684358:0:19396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17140:x1875967130919040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10380us (11430us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789062077.684371:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789062077.684442:0:17140:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789062077.684450:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7512300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17140:1875967130919040:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789062077.684466:0:17140:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000040:00080000:2.0:1789062078.186578:0:17867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1789062078.422718:0:19435:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789062078.422722:0:19435:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789062078.422723:0:19435:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789062078.423154:0:19435:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9767c74b8800 00000020:01000004:3.0:1789062078.423170:0:19435:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789062078.423185:0:19435:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789062078.423206:0:19435:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9766c628cd40) 00000020:00000080:3.0:1789062078.423223:0:19435:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789062078.466954:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789062078.467434:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789062078.467759:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789062078.468385:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789062078.468640:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789062078.468895:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789062078.469096:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1789062078.471560:0:19435:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789062078.472088:0:19435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789062078.472103:0:19435:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789062078.472116:0:19435:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2774d8f311dc7c04 00000020:01000004:1.0:1789062078.472124:0:19435:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789062078.472145:0:19435:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789062078.472149:0:19435:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789062078.472155:0:19435:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789062078.472183:0:19435:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789062078.472188:0:19435:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789062078.480388:0:19435:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789062078.480437:0:19435:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789062078.480442:0:19435:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789062078.480444:0:19435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789062078.480445:0:19435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789062078.480447:0:19435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789062078.480448:0:19435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789062078.480449:0:19435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789062078.480451:0:19435:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789062078.480452:0:19435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789062078.480454:0:19435:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789062078.480457:0:19435:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789062078.480460:0:19435:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789062078.480461:0:19435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789062078.480462:0:19435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789062078.480463:0:19435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789062078.480464:0:19435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789062078.480465:0:19435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789062078.480466:0:19435:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789062078.480467:0:19435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789062078.480474:0:19435:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789062078.480498:0:19435:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789062078.480519:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919168:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789062078.480587:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062078.481142:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c98449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789062078.481186:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130919168 00000100:00100000:2.0:1789062078.481194:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130919168 00000100:00100000:2.0:1789062078.481278:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789062078.481287:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+21:19435:x1875967130919168:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789062078.481314:0:17108:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789062078.481316:0:17108:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789062078.481320:0:17108:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789062078.481627:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+21:19435:x1875967130919168:12345-0@lo:253:mount.lustre.0 Request processed in 341us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062078.481636:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789062078.481730:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919168:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789062078.481742:0:19435:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789062078.481745:0:19435:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789062078.481746:0:19435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789062078.481747:0:19435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789062078.481749:0:19435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789062078.481750:0:19435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789062078.481751:0:19435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789062078.481752:0:19435:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789062078.481754:0:19435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789062078.481755:0:19435:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789062078.481775:0:19435:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9767c74b8800 from lustre-OST0001 10000000:01000000:3.0:1789062078.481803:0:19435:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789062078.481806:0:19435:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789062078.481814:0:19435:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9767fb3299c0 local copy 00010000:00010000:3.0:1789062078.481823:0:19435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062078.481964:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062078.482000:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.482222:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d02479c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062078.482306:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130919296 00000100:00100000:1.0:1789062078.482312:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130919296 00000100:00100000:1.0:1789062078.482337:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789062078.482343:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+21:19435:x1875967130919296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789062078.482415:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+21:19435:x1875967130919296:12345-0@lo:501:mount.lustre.0 Request processed in 71us (414us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789062078.482423:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789062078.482541:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919296:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789062078.482555:0:19435:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789062078.482572:0:19435:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789062078.482578:0:19435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062078.482588:0:19435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c8198000/0x2774d8f311dc7853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc785a expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789062078.482638:0:19435:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9767c74b8800 10000000:01000000:3.0:1789062078.482643:0:19435:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789062078.482648:0:19435:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789062078.482650:0:19435:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789062078.482655:0:19435:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789062078.482657:0:19435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789062078.482680:0:19435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807b400/0x2774d8f311dc7c0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062078.482689:0:19435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c807b400/0x2774d8f311dc7c0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062078.482708:0:19435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c807b400/0x2774d8f311dc7c0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062078.482721:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789062078.482749:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.482772:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d02479c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062078.482897:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130919424 00000100:00100000:1.0:1789062078.482902:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130919424 00000100:00100000:1.0:1789062078.482919:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789062078.482924:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+21:19435:x1875967130919424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789062078.482933:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789062078.482944:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc7c12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7c0b expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.482963:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc7c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7c0b expref: 22 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.482973:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47b400/0x2774d8f311dc7c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7c0b expref: 22 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.482982:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b400, rc 0) 00000100:00100000:1.0:1789062078.483007:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+22:19435:x1875967130919424:12345-0@lo:101:mount.lustre.0 Request processed in 82us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.483021:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789062078.483087:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789062078.483099:0:19435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c807b400/0x2774d8f311dc7c0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c12 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062078.483109:0:19435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c807b400/0x2774d8f311dc7c0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7c12 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789062078.484051:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789062078.484590:0:19435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789062078.486821:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789062078.486879:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789062078.486906:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789062078.486937:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789062078.486955:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789062078.486968:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789062078.486993:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789062078.486999:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789062078.487099:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062078.487164:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.487241:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c98449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789062078.492352:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130919552 00000100:00100000:0.0:1789062078.492367:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130919552 00000100:00100000:1.0:1789062078.494949:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789062078.494970:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+22:19435:x1875967130919552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789062078.495177:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+22:19435:x1875967130919552:12345-0@lo:501:mount.lustre.0 Request processed in 216us (8013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.495186:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789062078.495299:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062078.495351:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789062078.495405:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.495434:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c98449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789062078.495664:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130919680 00000100:00100000:2.0:1789062078.495672:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130919680 00000100:00100000:2.0:1789062078.495730:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789062078.495739:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+22:19435:x1875967130919680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789062078.496443:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+22:19435:x1875967130919680:12345-0@lo:503:mount.lustre.0 Request processed in 705us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062078.496451:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789062078.497499:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919680:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789062078.497956:0:19435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789062078.498035:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789062078.498104:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.498138:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727240 going to sleep for 11 seconds 00000100:00100000:1.0:1789062078.498297:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130919808 00000100:00100000:1.0:1789062078.498303:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130919808 00000100:00100000:1.0:1789062078.498337:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789062078.498345:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+22:19435:x1875967130919808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789062078.498913:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+22:19435:x1875967130919808:12345-0@lo:502:mount.lustre.0 Request processed in 568us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.498921:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789062078.499846:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789062078.500077:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789062078.500106:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789062078.500121:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789062078.500134:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789062078.500147:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789062078.500159:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789062078.500172:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789062078.500186:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789062078.500199:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789062078.500229:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789062078.500283:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.500316:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727240 going to sleep for 11 seconds 00000100:00100000:2.0:1789062078.500450:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130919936 00000100:00100000:2.0:1789062078.500458:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130919936 00000100:00100000:2.0:1789062078.500491:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789062078.500499:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+22:19435:x1875967130919936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062078.500599:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+22:19435:x1875967130919936:12345-0@lo:502:mount.lustre.0 Request processed in 100us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062078.500629:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789062078.501715:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130919936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789062078.501784:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789062078.501796:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789062078.503089:0:19439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789062078.503098:0:19439:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789062078.503104:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789062078.503106:0:19439:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789062078.503111:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789062078.503125:0:19439:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9767f3830000) 00000020:00000080:2.0:1789062078.503148:0:19439:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789062078.503153:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789062078.503225:0:19439:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767c74b8800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789062078.503234:0:19439:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789062078.503240:0:19439:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2774d8f311dc7c20 00010000:00010000:0.0:1789062078.506851:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062078.516555:0:19439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789062078.519297:0:19439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1789062078.521469:0:19439:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789062078.527285:0:19439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789062078.527297:0:19439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789062078.527303:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062078.527305:0:19439:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789062078.527315:0:19439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789062078.527319:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062078.527320:0:19439:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789062078.527323:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789062078.527325:0:19439:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789062078.527328:0:19439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789062078.527330:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062078.527331:0:19439:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789062078.527334:0:19439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789062078.527336:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062078.527337:0:19439:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789062078.527341:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789062078.527367:0:19439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789062078.527369:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789062078.527371:0:19439:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789062078.527374:0:19439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789062078.528892:0:19435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789062078.528929:0:19435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789062078.528950:0:19435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807b400/0x2774d8f311dc7c0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c12 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062078.528964:0:19435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c807b400/0x2774d8f311dc7c0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c12 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789062078.528972:0:19435:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767c74b8800 from 1 10000000:01000000:3.0:1789062078.528976:0:19435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789062078.529018:0:19435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062078.529026:0:19435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062078.529038:0:19435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062078.529061:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789062078.529127:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.529162:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789062078.529921:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130920064 00000100:00100000:0.0:1789062078.529929:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130920064 00000100:00100000:0.0:1789062078.529977:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789062078.529985:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+22:19435:x1875967130920064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789062078.530000:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062078.530012:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8198c00/0x2774d8f311dc7c2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7c27 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062078.530035:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8198c00/0x2774d8f311dc7c2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7c27 expref: 23 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062078.530047:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8198c00/0x2774d8f311dc7c2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7c27 expref: 23 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062078.530055:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198c00, rc 0) 00000100:00100000:0.0:1789062078.530114:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+23:19435:x1875967130920064:12345-0@lo:101:mount.lustre.0 Request processed in 130us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062078.530128:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789062078.530359:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789062078.530375:0:19435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c2e expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062078.530391:0:19435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7c2e expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789062078.534843:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789062078.535123:0:19435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789062078.535308:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789062078.535334:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789062078.535352:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789062078.535357:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789062078.535425:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062078.535490:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062078.535533:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c6e9ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789062078.535729:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130920192 00000100:00100000:0.0:1789062078.535736:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130920192 00000100:00100000:0.0:1789062078.535781:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789062078.535800:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+23:19435:x1875967130920192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789062078.535911:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+23:19435:x1875967130920192:12345-0@lo:501:mount.lustre.0 Request processed in 119us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062078.535919:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789062078.536165:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789062078.536196:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789062078.536231:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062078.536259:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c6e9ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789062078.536577:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130920320 00000100:00100000:0.0:1789062078.536583:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130920320 00000100:00100000:0.0:1789062078.536638:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789062078.536645:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+23:19435:x1875967130920320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789062078.536735:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+23:19435:x1875967130920320:12345-0@lo:503:mount.lustre.0 Request processed in 90us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062078.536742:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789062078.540527:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920320:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789062078.541113:0:19435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789062078.541198:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062078.543945:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062078.543997:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d6919e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789062078.544026:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130920448 00000100:00100000:2.0:1789062078.544033:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130920448 00000100:00100000:2.0:1789062078.544086:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789062078.544095:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+23:19435:x1875967130920448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062078.544236:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+23:19435:x1875967130920448:12345-0@lo:502:mount.lustre.0 Request processed in 142us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062078.544243:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789062078.544456:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789062078.544677:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789062078.545435:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789062078.545455:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789062078.545469:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789062078.545501:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789062078.545516:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789062078.545528:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789062078.545538:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789062078.545549:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789062078.545559:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789062078.545569:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789062078.545637:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789062078.545698:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062078.546236:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d6919e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789062078.546354:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130920576 00000100:00100000:0.0:1789062078.546362:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130920576 00000100:00100000:0.0:1789062078.546415:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789062078.546424:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+23:19435:x1875967130920576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789062078.546550:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+23:19435:x1875967130920576:12345-0@lo:502:mount.lustre.0 Request processed in 127us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062078.546557:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789062078.546750:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789062078.546834:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789062078.546844:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789062078.547962:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789062078.547972:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789062078.547974:0:19443:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789062078.547981:0:19443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767c74b8800 00000020:00000080:3.0:1789062078.547984:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789062078.547990:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789062078.547993:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789062078.547994:0:19443:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789062078.547997:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789062078.547999:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789062078.548000:0:19443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789062078.548003:0:19443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9767c74b8800 00000020:00000080:3.0:1789062078.548004:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789062078.548061:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789062078.548065:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789062078.548067:0:19443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789062078.548081:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789062078.548084:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789062078.548085:0:19443:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789062078.548089:0:19443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767c74b8800 00000020:00000080:3.0:1789062078.548091:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789062078.548109:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789062078.548112:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789062078.548113:0:19443:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789062078.548116:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789062078.548118:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789062078.548119:0:19443:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789062078.548123:0:19443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9767c74b8800 00000020:00000080:3.0:1789062078.548125:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789062078.548146:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789062078.548149:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789062078.548150:0:19443:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789062078.548153:0:19443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789062078.548284:0:19435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789062078.548310:0:19435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789062078.548332:0:19435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c2e expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062078.548344:0:19435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c2e expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062078.548392:0:19435:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789062078.548395:0:19435:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9767c74b8800 10000000:01000000:2.0:1789062078.548399:0:19435:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9767c74b8800 10000000:01000000:2.0:1789062078.548408:0:19435:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789062078.548413:0:19435:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9767c74b8800 from 1 10000000:01000000:2.0:1789062078.548416:0:19435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789062078.548446:0:19435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc7c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062078.548454:0:19435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc7c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062078.548463:0:19435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc7c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062078.548484:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789062078.548540:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062078.548572:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d6919540 going to sleep for 11 seconds 00000100:00100000:0.0:1789062078.548923:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130920704 00000100:00100000:0.0:1789062078.548931:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130920704 00000100:00100000:0.0:1789062078.548975:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789062078.548983:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+23:19435:x1875967130920704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789062078.549000:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062078.549012:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8198a00/0x2774d8f311dc7c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7c35 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062078.549035:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8198a00/0x2774d8f311dc7c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7c35 expref: 24 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062078.549046:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8198a00/0x2774d8f311dc7c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7c35 expref: 24 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062078.549054:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198a00, rc 0) 00000100:00100000:0.0:1789062078.549101:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+24:19435:x1875967130920704:12345-0@lo:101:mount.lustre.0 Request processed in 118us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062078.549107:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789062078.550010:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789062078.550029:0:19435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc7c35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c3c expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062078.550039:0:19435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc7c35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7c3c expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789062078.552129:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1789062078.552480:0:19435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789062078.555016:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789062078.555068:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789062078.555083:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789062078.555095:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789062078.555107:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789062078.555120:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789062078.555143:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789062078.555157:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789062078.555169:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789062078.555181:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789062078.555193:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789062078.555206:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789062078.555233:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789062078.555248:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789062078.555261:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789062078.555272:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789062078.555283:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789062078.555293:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789062078.555304:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789062078.555314:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789062078.555325:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789062078.555337:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789062078.555349:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789062078.555363:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789062078.555377:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789062078.555390:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789062078.555402:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789062078.555415:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789062078.555443:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789062078.555459:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789062078.555470:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789062078.555481:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789062078.555490:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789062078.555500:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789062078.555512:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789062078.555523:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789062078.555533:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789062078.555543:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789062078.555553:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1789062078.555574:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1789062078.555584:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1789062078.555594:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1789062078.555621:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1789062078.555636:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1789062078.555660:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1789062078.555674:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1789062078.555696:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1789062078.555700:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1789062078.555805:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062078.555871:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.555932:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789062078.561018:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130920832 00000100:00100000:1.0:1789062078.561033:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130920832 00000100:00100000:1.0:1789062078.561091:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789062078.561101:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+24:19435:x1875967130920832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062078.561349:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789062078.561394:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789062078.566683:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.566740:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789062078.571366:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130920960 00000100:00100000:0.0:1789062078.571380:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130920960 00000100:00100000:0.0:1789062078.571430:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789062078.571439:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+25:19435:x1875967130920960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789062078.571588:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd819450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+25:19435:x1875967130920960:12345-0@lo:503:mount.lustre.0 Request processed in 149us (4912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062078.571595:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789062078.571852:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+24:19435:x1875967130920832:12345-0@lo:501:mount.lustre.0 Request processed in 10752us (15980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.571859:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789062078.572027:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130920960:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789062078.573092:0:19435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789062078.573170:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130921088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789062078.573228:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.573373:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c77279c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789062078.580401:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130921088 00000100:00100000:0.0:1789062078.580416:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130921088 00000100:00100000:0.0:1789062078.580470:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789062078.580479:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+24:19435:x1875967130921088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789062078.580660:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd819850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+24:19435:x1875967130921088:12345-0@lo:502:mount.lustre.0 Request processed in 181us (7430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062078.580678:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789062078.580920:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130921088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789062078.581120:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789062078.581148:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789062078.581163:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789062078.581176:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789062078.581188:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789062078.581210:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789062078.581224:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789062078.581236:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789062078.581335:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789062078.581352:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789062078.581366:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789062078.581379:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789062078.581392:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789062078.581406:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789062078.581419:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789062078.581431:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789062078.581442:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789062078.581455:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789062078.581467:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789062078.581480:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789062078.581492:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789062078.581504:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789062078.581517:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789062078.581531:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789062078.581556:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789062078.581569:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789062078.581580:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789062078.581590:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789062078.581602:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789062078.581909:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789062078.581922:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789062078.581933:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789062078.581945:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789062078.581956:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789062078.581967:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789062078.581978:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789062078.581989:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789062078.582002:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789062078.582022:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789062078.582035:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789062078.582058:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789062078.582072:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789062078.582084:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789062078.582096:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789062078.582107:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789062078.582119:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789062078.582131:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789062078.582143:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789062078.582187:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130921216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789062078.582249:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.582484:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c77279c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789062078.583847:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130921216 00000100:00100000:3.0:1789062078.583857:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130921216 00000100:00100000:3.0:1789062078.583914:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789062078.583922:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:19435:x1875967130921216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789062078.584058:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:19435:x1875967130921216:12345-0@lo:502:mount.lustre.0 Request processed in 137us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062078.584065:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789062078.584121:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130921216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789062078.584683:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789062078.584798:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789062078.584833:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130921344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789062078.585031:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.585062:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c77279c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789062078.585105:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130921344 00000100:00100000:0.0:1789062078.585110:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130921344 00000100:00100000:0.0:1789062078.585146:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789062078.585153:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+24:19435:x1875967130921344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789062078.585248:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+24:19435:x1875967130921344:12345-0@lo:502:mount.lustre.0 Request processed in 95us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062078.585262:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789062078.585395:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130921344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789062078.585443:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789062078.585450:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789062078.586345:0:19448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789062078.586361:0:19448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9767f7e90000) 00000020:00000080:1.0:1789062078.586390:0:19448:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789062078.586466:0:19448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767c74b8800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789062078.586470:0:19448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767c74b8800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789062078.586472:0:19448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767c74b8800 3 00010000:00080000:1.0:1789062078.586503:0:19448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9766c754b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1789062078.589014:0:19448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789062078.589212:0:19448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789062078.589267:0:19448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789062078.589282:0:19448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2774d8f311dc7c4a 00000100:00080000:1.0:1789062078.589292:0:19448:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789062078.589302:0:19448:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9766c754b000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062078.589349:0:19448:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c75d6d80 x1875967130921472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789062078.589386:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875967130921472:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789062078.589448:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062078.589507:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130921472 00000100:00100000:1.0:1789062078.589514:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130921472 00000100:00100000:1.0:1789062078.589542:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789062078.589549:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875967130921472:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789062078.589571:0:17117:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:1.0:1789062078.589602:0:17117:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2774d8f311dc7c51 00000004:00100000:1.0:1789062078.589636:0:17117:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789062078.589665:0:17117:0:(import.c:65:import_set_state_nolock()) ffff9766c7548000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789062078.591471:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875967130921472:12345-0@lo:38:llog_process_th.0 Request processed in 1913us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.591482:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789062078.591517:0:19448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789062078.592546:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062078.592552:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789062078.592556:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789062078.592562:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:2.0:1789062078.592565:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789062078.592574:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9767c3f65800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062078.592593:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c7513100 x1875967130921856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789062078.592806:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789062078.592822:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130921600:0@lo:400:kworker.0 00000100:00100000:1.0:1789062078.592877:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062078.592931:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130921600 00000100:00100000:1.0:1789062078.592937:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130921600 00000100:00100000:1.0:1789062078.592976:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789062078.592984:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130921600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062078.593031:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130921600:12345-0@lo:400:kworker.0 Request processed in 47us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.593037:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789062078.593077:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130921600:0@lo:400:kworker.0 00000100:00080000:2.0:1789062078.593362:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789062078.593366:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789062078.593369:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789062078.593374:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 458 00000100:00080000:2.0:1789062078.593377:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789062078.593390:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9767c3f78000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1789062078.593405:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c7512300 x1875967130922368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789062078.593451:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130921728:0@lo:400:kworker.0 00000100:00100000:2.0:1789062078.593482:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062078.593503:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130922496:0@lo:400:kworker.0 00000100:00100000:2.0:1789062078.593526:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062078.593547:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789062078.593553:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130921984:0@lo:400:kworker.0 00000100:00100000:2.0:1789062078.593575:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062078.593593:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130922624:0@lo:400:kworker.0 00000100:00100000:2.0:1789062078.593641:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062078.593670:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130921728 00000100:00100000:2.0:1789062078.593674:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130921728 00000100:00100000:3.0:1789062078.593888:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130922240:0@lo:400:kworker.0 00000100:00100000:3.0:1789062078.593920:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062078.593972:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130922112:0@lo:400:kworker.0 00000100:00100000:1.0:1789062078.593999:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062078.594019:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130922752:0@lo:400:kworker.0 00000100:00100000:1.0:1789062078.594037:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062078.594059:0:18432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130922112 00000100:00100000:1.0:1789062078.594063:0:18432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130922112 00000100:00100000:1.0:1789062078.594086:0:18432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789062078.594093:0:18432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130922112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062078.594131:0:18432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130922112:12345-0@lo:400:kworker.0 Request processed in 38us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.594137:0:18432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789062078.594167:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130922112:0@lo:400:kworker.0 00010000:00080000:0.0:1789062078.594294:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c75d6d80 x1875967130921472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789062088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062078.594304:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789062078.594312:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789062078.594319:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789062078.594324:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789062078.594327:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9766c754b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789062078.594334:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875967130921472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789062078.594351:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130921856:0@lo:8:kworker.0 00000020:01000004:1.0:1789062078.594588:0:19448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789062078.594626:0:19448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9767f7e93380) 00000020:00000080:1.0:1789062078.594649:0:19448:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1789062078.594758:0:19448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9767c74b8800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789062078.594762:0:19448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9767c74b8800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789062078.594765:0:19448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9767c74b8800 3 00010000:00080000:1.0:1789062078.595032:0:19448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9766c754e000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.103@tcp at head 00000100:00100000:0.0:1789062078.596675:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130922496 00000100:00100000:0.0:1789062078.596686:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130922496 00000100:00100000:0.0:1789062078.596734:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130921984 00000100:00100000:0.0:1789062078.596737:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130921984 00000100:00100000:0.0:1789062078.596749:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130922624 00000100:00100000:0.0:1789062078.596751:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130922624 00000100:00100000:0.0:1789062078.596779:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130922752 00000100:00100000:0.0:1789062078.596781:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130922752 00000100:00100000:0.0:1789062078.596809:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789062078.596824:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130922496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062078.596916:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875967130922496:12345-0@lo:400:kworker.0 Request processed in 92us (3388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062078.596922:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789062078.596937:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789062078.596943:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130921984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062078.596969:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130921984:12345-0@lo:400:kworker.0 Request processed in 27us (3393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062078.596975:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789062078.596985:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789062078.596991:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130922624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062078.597017:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130922624:12345-0@lo:400:kworker.0 Request processed in 26us (3374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062078.597022:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789062078.597033:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789062078.597038:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130922752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062078.597069:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130922752:12345-0@lo:400:kworker.0 Request processed in 31us (3031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062078.597074:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789062078.598018:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789062078.598025:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789062078.598063:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c748ca80 x1875967130922752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062078.598077:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130922752:0@lo:400:kworker.0 00010000:00010000:1.0:1789062078.598781:0:19448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1789062078.599003:0:19448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789062078.599048:0:19448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789062078.599060:0:19448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2774d8f311dc7c5f 00000100:00080000:1.0:1789062078.599068:0:19448:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789062078.599077:0:19448:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9766c754e000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1789062078.599105:0:19448:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c8170e00 x1875967130922880/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789062078.599555:0:19448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00080000:0.0:1789062078.601777:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c7512680 x1875967130921984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062078.601806:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130921984:0@lo:400:kworker.0 00010000:00080000:0.0:1789062078.601821:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c748ea00 x1875967130922624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062078.601845:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130922624:0@lo:400:kworker.0 00010000:00080000:0.0:1789062078.601861:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c748c700 x1875967130922496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062078.601869:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c748c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875967130922496:0@lo:400:kworker.0 00000100:00100000:2.0:1789062078.602204:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130922240 00000100:00100000:2.0:1789062078.602211:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130922240 00000100:00100000:2.0:1789062078.602291:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789062078.602300:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130921728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062078.602374:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130921728:12345-0@lo:400:kworker.0 Request processed in 75us (8890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062078.602381:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789062078.602397:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789062078.602404:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130922240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062078.602437:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130922240:12345-0@lo:400:kworker.0 Request processed in 34us (8516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062078.602443:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789062078.602480:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130921728:0@lo:400:kworker.0 00000100:00100000:2.0:1789062078.602531:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130922240:0@lo:400:kworker.0 00000100:00080000:3.0:1789062078.602937:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789062078.604084:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062078.604132:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130922368:0@lo:8:kworker.0 00000100:00100000:1.0:1789062078.604175:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062078.604206:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875967130922880:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789062078.604248:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062078.604337:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130921856 00000100:00100000:0.0:1789062078.604344:0:19396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130921856 00000100:00100000:0.0:1789062078.604369:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130922368 00000100:00100000:0.0:1789062078.604371:0:19396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130922368 00000100:00100000:0.0:1789062078.604384:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789062078.604391:0:19396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3619:x1875967130921856:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789062078.604442:0:19396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3619:x1875967130921856:12345-0@lo:8:kworker.0 Request processed in 50us (360us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789062078.604448:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789062078.604460:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789062078.604463:0:19396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3619:x1875967130922368:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789062078.604488:0:19396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3619:x1875967130922368:12345-0@lo:8:kworker.0 Request processed in 23us (312us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789062078.604493:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789062078.604583:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789062078.604590:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062078.604594:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789062078.604598:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130921856:0@lo:8:kworker.0 00000100:00100000:1.0:1789062078.604645:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789062078.604648:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789062078.604651:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789062078.604654:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130922368:0@lo:8:kworker.0 00000100:00100000:1.0:1789062078.604693:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130922880 00000100:00100000:1.0:1789062078.604697:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130922880 00000100:00100000:1.0:1789062078.604844:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789062078.604850:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875967130922880:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789062078.604867:0:17116:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:1.0:1789062078.604909:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2774d8f311dc7c66 00000004:00100000:1.0:1789062078.604923:0:17116:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789062078.604950:0:17116:0:(import.c:65:import_set_state_nolock()) ffff9766c754e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789062078.604994:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875967130922880:12345-0@lo:38:llog_process_th.0 Request processed in 143us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.605001:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1789062078.605103:0:19448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00010000:00080000:2.0:1789062078.605254:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766c8170e00 x1875967130922880/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789062088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062078.605274:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789062078.605281:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789062078.605287:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789062078.605292:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789062078.605294:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9766c754e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789062078.605298:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875967130922880:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1789062078.607061:0:19435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789062078.607103:0:19435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789062078.607155:0:19435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc7c35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c3c expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062078.607167:0:19435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1483000/0x2774d8f311dc7c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c3c expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789062078.607225:0:19435:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789062078.607227:0:19435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789062078.607228:0:19435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789062078.607230:0:19435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789062078.607231:0:19435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789062078.607232:0:19435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789062078.607234:0:19435:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789062078.607235:0:19435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789062078.607237:0:19435:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789062078.607240:0:19435:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789062078.607243:0:19435:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789062078.607244:0:19435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789062078.607245:0:19435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789062078.607246:0:19435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789062078.607247:0:19435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789062078.607248:0:19435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789062078.607249:0:19435:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789062078.607250:0:19435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789062078.607251:0:19435:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789062078.607286:0:19435:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789062078.607302:0:19435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130923008:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789062078.607360:0:19435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062078.607433:0:19435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c7727180 going to sleep for 11 seconds 00000100:00100000:1.0:1789062078.611777:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130923008 00000100:00100000:1.0:1789062078.611849:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130923008 00000100:00100000:1.0:1789062078.611958:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789062078.611968:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+24:19435:x1875967130923008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789062078.611997:0:17109:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789062078.612011:0:17109:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789062078.617646:0:17109:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789062078.617662:0:17109:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789062078.617777:0:17131:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789062078.617782:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789062078.617812:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.617837:0:17131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc7b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7b0f expref: 24 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.617845:0:17131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c807a200/0x2774d8f311dc7b24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7b1d expref: 24 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.617852:0:17131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.617897:0:17131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c807a200/0x2774d8f311dc7b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7b1d expref: 24 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.617911:0:17131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766c807a200/0x2774d8f311dc7b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7b1d expref: 24 pid: 17109 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062078.617926:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130923136:0@lo:104: 00000100:00100000:1.0:1789062078.617983:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789062078.618029:0:17131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc7b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7b0f expref: 24 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618037:0:17131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc7b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7b0f expref: 24 pid: 17110 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062078.618046:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8173480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130923264:0@lo:104: 00000100:00100000:1.0:1789062078.618066:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062078.618080:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c15ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1789062078.618099:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130923136 00000100:00100000:1.0:1789062078.618107:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130923136 00000100:00100000:1.0:1789062078.618141:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130923264 00000100:00100000:1.0:1789062078.618150:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130923264 00000100:00100000:1.0:1789062078.618169:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789062078.618177:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+4:17131:x1875967130923136:12345-0@lo:104: 00010000:00010000:1.0:1789062078.618189:0:17099:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7b24 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618236:0:17099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789062078.618242:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+4:17131:x1875967130923136:12345-0@lo:104: Request processed in 66us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.618248:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789062078.618274:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789062078.618280:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+3:17131:x1875967130923264:12345-0@lo:104: 00010000:00010000:1.0:1789062078.618288:0:17099:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7b16 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618316:0:17099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789062078.618320:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+3:17131:x1875967130923264:12345-0@lo:104: Request processed in 41us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.618326:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789062078.618341:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789062078.618347:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7b24 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618353:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198200 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789062078.618357:0:17103:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7b24 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618364:0:17103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7b24 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789062078.618382:0:17103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7b24 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789062078.618388:0:17103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789062078.618415:0:17103:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7b24 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618422:0:17103:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789062078.618440:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7b24 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618446:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c8198200/0x2774d8f311dc7b1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7b24 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618455:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789062078.618458:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7b16 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618462:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198e00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:1.0:1789062078.618465:0:17103:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7b16 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618471:0:17103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7b16 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789062078.618476:0:17103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7b16 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789062078.618481:0:17103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789062078.618499:0:17103:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7b16 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618504:0:17103:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789062078.618517:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7b16 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618523:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c8198e00/0x2774d8f311dc7b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7b16 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618533:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062078.618534:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062078.618536:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062078.618541:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062078.618554:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789062078.618563:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83f5b9c6-643c-4659-afe5-bacf144ade05:3620:1875967130923392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789062078.618587:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062078.618629:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130923520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789062078.618650:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062078.618682:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130923392 00000100:00100000:1.0:1789062078.618686:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130923392 00010000:00010000:1.0:1789062078.618703:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c807a200/0x2774d8f311dc7b24 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7b1d expref: 25 pid: 17109 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062078.618722:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130923520 00000100:00100000:1.0:1789062078.618724:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130923520 00010000:00010000:1.0:1789062078.618734:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc7b16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7b0f expref: 26 pid: 17110 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062078.618745:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789062078.618751:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+26:3620:x1875967130923392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789062078.618768:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789062078.618773:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766c807a200/0x2774d8f311dc7b24 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7b1d expref: 26 pid: 17109 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618783:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c807a200/0x2774d8f311dc7b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7b1d expref: 26 pid: 17109 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618797:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789062078.618824:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+26:3620:x1875967130923392:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.618831:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789062078.618844:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789062078.618849:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+25:3622:x1875967130923520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789062078.618856:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789062078.618860:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc7b16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7b0f expref: 25 pid: 17110 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618869:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc7b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7b0f expref: 25 pid: 17110 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618890:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618898:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789062078.618912:0:17100:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007365808s 00010000:00010000:1.0:1789062078.618916:0:17100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618933:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618939:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618945:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618950:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ba00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789062078.618953:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618960:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618969:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.618978:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789062078.619007:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+25:3622:x1875967130923520:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.619014:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789062078.619050:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130923520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789062078.619072:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83f5b9c6-643c-4659-afe5-bacf144ade05:3620:1875967130923392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789062078.619097:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c807a200/0x2774d8f311dc7b24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7b1d expref: 24 pid: 17109 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062078.619115:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130923136:0@lo:104: 00010000:00010000:1.0:1789062078.619126:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1482c00/0x2774d8f311dc7b16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7b0f expref: 23 pid: 17110 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062078.619134:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8173480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17131:1875967130923264:0@lo:104: 00010000:00010000:1.0:1789062078.619147:0:17131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.619154:0:17131:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.619160:0:17131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062078.619165:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47ba00/0x2774d8f311dc7c6d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062078.619773:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd818450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+22:19435:x1875967130923008:12345-0@lo:253:mount.lustre.0 Request processed in 7805us (12411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062078.619782:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789062078.619939:0:19435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:83f5b9c6-643c-4659-afe5-bacf144ade05:19435:1875967130923008:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789062078.619950:0:19435:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789062078.619953:0:19435:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789062078.619954:0:19435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789062078.619956:0:19435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789062078.619957:0:19435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789062078.619958:0:19435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789062078.619960:0:19435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789062078.619961:0:19435:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789062078.619970:0:19435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789062078.619972:0:19435:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789062078.619984:0:19435:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1789062078.630404:0:19435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789062078.637580:0:19435:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789062078.637588:0:19435:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789062078.637653:0:19435:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789062078.637692:0:19435:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789062078.637723:0:19435:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789062078.637746:0:19435:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789062078.638517:0:19435:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789062078.638763:0:19435:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789062079.529822:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789062079.553040:0:19501:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789062079.553599:0:19501:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1789062080.107523:0:17112:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789062080.107532:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767fb2fe000 from 10 10000000:01000000:1.0:1789062080.107537:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789062080.107581:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47aa00/0x2774d8f311dc7c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062080.107727:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767fd47aa00/0x2774d8f311dc7c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062080.107740:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767fd47aa00/0x2774d8f311dc7c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062080.107766:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8173480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130923648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789062080.107831:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062080.107879:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767ce23a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789062080.107939:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130923648 00000100:00100000:0.0:1789062080.107947:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130923648 00000100:00100000:0.0:1789062080.107998:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789062080.108007:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+22:17112:x1875967130923648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789062080.108020:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062080.108033:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8199c00/0x2774d8f311dc7c7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7c74 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062080.108055:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8199c00/0x2774d8f311dc7c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7c74 expref: 23 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062080.108073:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8199c00/0x2774d8f311dc7c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7c74 expref: 23 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062080.108081:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199c00, rc 0) 00000100:00100000:0.0:1789062080.108121:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd819c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+23:17112:x1875967130923648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062080.108127:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789062080.108170:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8173480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130923648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789062080.108183:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767fd47aa00/0x2774d8f311dc7c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c7b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062080.108192:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767fd47aa00/0x2774d8f311dc7c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7c7b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062080.108242:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130923776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789062080.108278:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062080.108290:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062080.108460:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130923776 00000100:00100000:1.0:1789062080.108465:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130923776 00000100:00100000:1.0:1789062080.108495:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789062080.108502:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+23:17112:x1875967130923776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789062080.108516:0:17108:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789062080.108532:0:17108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789062080.108536:0:17108:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789062080.108693:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+23:17112:x1875967130923776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 191us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062080.108700:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789062080.108825:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130923776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789062080.108892:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789062080.108900:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767fd47aa00/0x2774d8f311dc7c74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c7b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062080.108909:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767fd47aa00/0x2774d8f311dc7c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c7b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062080.108927:0:17112:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789062080.108930:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9767f7e7a800 from 10 10000000:01000000:2.0:1789062080.108932:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789062080.108949:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482000/0x2774d8f311dc7c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062080.108956:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c1482000/0x2774d8f311dc7c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062080.108963:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c1482000/0x2774d8f311dc7c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062080.108976:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130923904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789062080.109003:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062080.109031:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1789062080.109083:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130923904 00000100:00100000:0.0:1789062080.109088:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130923904 00000100:00100000:0.0:1789062080.109119:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789062080.109124:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+23:17112:x1875967130923904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789062080.109131:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062080.109141:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7c89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7c82 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062080.109156:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7c82 expref: 24 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062080.109165:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8199000/0x2774d8f311dc7c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7c82 expref: 24 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062080.109172:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199000, rc 0) 00000100:00100000:0.0:1789062080.109202:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd819050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:17112:x1875967130923904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062080.109397:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789062080.109446:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130923904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789062080.109457:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c1482000/0x2774d8f311dc7c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c89 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062080.109465:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c1482000/0x2774d8f311dc7c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7c89 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062080.109506:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130924032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789062080.109533:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062080.109547:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c66fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1789062080.109687:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130924032 00000100:00100000:0.0:1789062080.109691:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130924032 00000100:00100000:0.0:1789062080.109713:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789062080.109719:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:17112:x1875967130924032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789062080.109729:0:17110:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789062080.109741:0:17110:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789062080.109744:0:17110:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789062080.109817:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:17112:x1875967130924032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062080.109821:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130924032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789062080.109829:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 10000000:01000000:3.0:1789062080.110038:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789062080.110119:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c1482000/0x2774d8f311dc7c82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c89 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062080.110126:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c1482000/0x2774d8f311dc7c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7c89 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062080.555370:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062081.578893:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062081.707289:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130924160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789062081.707368:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062081.707430:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130924160 00000100:00100000:1.0:1789062081.707437:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130924160 00000100:00100000:1.0:1789062081.707502:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789062081.707511:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130924160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789062081.707549:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789062081.707594:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130924160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062081.707601:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789062081.707644:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789062081.707682:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130924160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789062082.217868:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789062082.217891:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130924288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789062082.217966:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062082.218108:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130924288 00000100:00100000:0.0:1789062082.218117:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130924288 00000100:00100000:0.0:1789062082.218181:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789062082.218196:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130924288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789062082.218424:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789062082.218483:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130924288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 288us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062082.218490:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789062082.218568:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130924288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789062082.218870:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130924416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789062082.218897:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062082.219364:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130924416 00000100:00100000:3.0:1789062082.219370:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130924416 00000100:00100000:3.0:1789062082.219407:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789062082.219416:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130924416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789062082.219436:0:17121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789062082.220655:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130924416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1235us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062082.220665:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789062082.223807:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130924416:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789062082.601814:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062082.730083:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130924544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789062082.730145:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062082.730202:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130924544 00000100:00100000:0.0:1789062082.730211:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130924544 00000100:00100000:0.0:1789062082.730323:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789062082.730333:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130924544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789062082.730354:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789062082.730394:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130924544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062082.730401:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789062082.730421:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789062082.730454:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130924544:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789062083.630872:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789062083.754069:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789062083.754076:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789062083.754079:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789062083.754094:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9767c3f65800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1789062083.754123:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c676b480 x1875967130925056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789062083.754155:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789062083.754159:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789062083.754160:0:36:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789062083.754166:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9767c3f78000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1789062083.754177:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766c6769c00 x1875967130925568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789062083.754247:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130924672:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.754312:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754347:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130925312:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.754373:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754391:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130925952:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.754415:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754436:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789062083.754442:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130925184:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.754460:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754476:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130925824:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.754496:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754521:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130924800:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.754541:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754557:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130925440:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.754577:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754598:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130926080:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.754646:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754658:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789062083.754664:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130924928:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.754689:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754705:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130925696:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.754723:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754732:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130926208:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.754752:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754773:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130925056:0@lo:8:kworker.0 00000100:00100000:0.0:1789062083.754796:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754812:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130925568:0@lo:8:kworker.0 00000100:00100000:0.0:1789062083.754830:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.754872:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130924672 00000100:00100000:0.0:1789062083.754879:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130924672 00000100:00100000:0.0:1789062083.754918:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789062083.754927:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:3623:x1875967130924672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.754973:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd818c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:3623:x1875967130924672:12345-0@lo:400:kworker.0 Request processed in 47us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.754980:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789062083.755005:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130925312 00000100:00100000:0.0:1789062083.755009:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130925312 00000100:00100000:0.0:1789062083.755028:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130924800 00000100:00100000:0.0:1789062083.755031:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130924800 00000100:00100000:0.0:1789062083.755044:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789062083.755050:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130925312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.755081:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130925312:12345-0@lo:400:kworker.0 Request processed in 31us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.755094:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789062083.755106:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789062083.755112:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130924800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.755143:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130924800:12345-0@lo:400:kworker.0 Request processed in 31us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.755149:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789062083.755165:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130925952 00000100:00100000:0.0:1789062083.755169:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130925952 00000100:00100000:0.0:1789062083.755193:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130925184 00000100:00100000:0.0:1789062083.755196:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130925184 00000100:00100000:0.0:1789062083.755205:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130925824 00000100:00100000:0.0:1789062083.755208:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130925824 00000100:00100000:0.0:1789062083.755218:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130926080 00000100:00100000:0.0:1789062083.755220:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130926080 00000100:00100000:0.0:1789062083.755231:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130925696 00000100:00100000:0.0:1789062083.755234:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130925696 00000100:00100000:0.0:1789062083.755243:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130926208 00000100:00100000:0.0:1789062083.755245:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130926208 00000100:00100000:0.0:1789062083.755257:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789062083.755263:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130925952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.755292:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875967130925952:12345-0@lo:400:kworker.0 Request processed in 29us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.755298:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789062083.755309:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789062083.755315:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130925184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.755340:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130925184:12345-0@lo:400:kworker.0 Request processed in 25us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.755346:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789062083.755364:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789062083.755369:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130925824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.755396:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130925824:12345-0@lo:400:kworker.0 Request processed in 27us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.755402:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789062083.755412:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789062083.755418:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130926080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.755458:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130926080:12345-0@lo:400:kworker.0 Request processed in 40us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.755464:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789062083.755475:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789062083.755480:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130925696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.755503:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875967130925696:12345-0@lo:400:kworker.0 Request processed in 23us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.755508:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789062083.755519:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789062083.755525:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130926208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.755548:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875967130926208:12345-0@lo:400:kworker.0 Request processed in 23us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.755552:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789062083.755576:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130925440 00000100:00100000:0.0:1789062083.755579:0:19396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130925440 00000100:00100000:0.0:1789062083.755625:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130924928 00000100:00100000:0.0:1789062083.755628:0:19396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130924928 00000100:00100000:0.0:1789062083.755641:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130925056 00000100:00100000:0.0:1789062083.755643:0:19396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130925056 00000100:00100000:0.0:1789062083.755650:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130925568 00000100:00100000:0.0:1789062083.755658:0:19396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130925568 00000100:00100000:0.0:1789062083.755670:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789062083.755675:0:19396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130925440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.755705:0:19396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130925440:12345-0@lo:400:kworker.0 Request processed in 30us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.755711:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789062083.755721:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789062083.755726:0:19396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130924928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.755748:0:19396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130924928:12345-0@lo:400:kworker.0 Request processed in 22us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.755754:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789062083.755763:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789062083.755767:0:19396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3619:x1875967130925056:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789062083.755791:0:19396:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:0.0:1789062083.755816:0:19396:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2774d8f311dc7c90 00002000:00100000:0.0:1789062083.755828:0:19396:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9767eb92c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789062083.755833:0:19396:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789062083.755836:0:19396:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789062083.755996:0:19396:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789062083.756017:0:19396:0:(import.c:65:import_set_state_nolock()) ffff9767eb92b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789062083.756054:0:19396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1875967130925056:12345-0@lo:8:kworker.0 Request processed in 285us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.756061:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789062083.756072:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789062083.756076:0:19396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3619:x1875967130925568:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789062083.756091:0:19396:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:0.0:1789062083.756111:0:19396:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2774d8f311dc7c97 00002000:00100000:0.0:1789062083.756118:0:19396:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9767eb92e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789062083.756121:0:19396:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1789062083.756123:0:19396:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789062083.756143:0:19396:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789062083.756155:0:19396:0:(import.c:65:import_set_state_nolock()) ffff9767eb92d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789062083.756182:0:19396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3619:x1875967130925568:12345-0@lo:8:kworker.0 Request processed in 104us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.756188:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789062083.756214:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789062083.756218:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789062083.756220:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789062083.756245:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676b480 x1875967130925056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789062108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789062083.756259:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789062083.756266:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789062083.756270:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789062083.756273:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f65800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789062083.756287:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789062083.756292:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875967130925056:0@lo:8:kworker.0 00010000:00080000:0.0:1789062083.756305:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6769c00 x1875967130925568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789062108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789062083.756314:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789062083.756318:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789062083.756321:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789062083.756324:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9767c3f78000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789062083.756340:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789062083.756349:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875967130925568:0@lo:8:kworker.0 00000004:00080000:0.0:1789062083.756373:0:17141:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789062083.756424:0:17141:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 464865817491ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789062083.756430:0:17141:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789062083.758287:0:17857:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789062083.758360:0:17857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 464867753416ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789062083.758367:0:17857:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789062083.759178:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130924928:0@lo:400:kworker.0 00010000:00080000:0.0:1789062083.759195:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676a300 x1875967130925696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062083.759204:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875967130925696:0@lo:400:kworker.0 00010000:00080000:0.0:1789062083.759215:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6768a80 x1875967130926208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062083.759229:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875967130926208:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.759241:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130924800:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.759251:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130925440:0@lo:400:kworker.0 00010000:00080000:0.0:1789062083.759261:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6768000 x1875967130926080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062083.759267:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130926080:0@lo:400:kworker.0 00010000:00080000:0.0:1789062083.759315:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6769180 x1875967130925184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062083.759330:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130925184:0@lo:400:kworker.0 00010000:00080000:0.0:1789062083.759341:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c676b100 x1875967130925824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062083.759349:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130925824:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.759368:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130924672:0@lo:400:kworker.0 00000100:00100000:0.0:1789062083.759378:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130925312:0@lo:400:kworker.0 00010000:00080000:0.0:1789062083.759388:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6769f80 x1875967130925952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062083.759395:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875967130925952:0@lo:400:kworker.0 00000004:00080000:0.0:1789062083.759464:0:17142:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1789062083.759484:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd346680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17142:1875967130926464:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789062083.759534:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.759557:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd5bbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789062083.759574:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130926464 00000100:00100000:0.0:1789062083.759580:0:19096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130926464 00000100:00100000:0.0:1789062083.759642:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789062083.759651:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17142:x1875967130926464:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1789062083.759822:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789062083.759829:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789062083.759837:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130926336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789062083.759874:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.759899:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130926336 00000100:00100000:0.0:1789062083.759903:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130926336 00000100:00100000:0.0:1789062083.759926:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789062083.759933:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1875967130926336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789062083.759949:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789062083.759986:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1875967130926336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062083.760002:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789062083.760034:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd344a80 x1875967130926336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789062099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062083.760047:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130926336:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789062083.760091:0:17858:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789062083.760105:0:17858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd347100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1875967130926720:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789062083.760129:0:17858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.760144:0:17858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9766c6750600 going to sleep for 11 seconds 00000100:00100000:3.0:1789062083.760626:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789062083.760636:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130926592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789062083.760670:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062083.760696:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130926592 00000100:00100000:3.0:1789062083.760700:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130926592 00000100:00100000:3.0:1789062083.760730:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789062083.760737:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1875967130926592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789062083.760747:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789062083.760776:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1875967130926592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062083.760793:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789062083.760812:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789062083.760829:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd344a80 x1875967130926592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789062099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789062083.760851:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130926592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789062083.763505:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130926720 00000100:00100000:0.0:1789062083.763519:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130926720 00000100:00100000:0.0:1789062083.763576:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789062083.763585:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17858:x1875967130926720:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789062083.766936:0:17847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1789062083.772930:0:17095:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1789062083.773984:0:18622:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789062083.773991:0:18622:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789062083.774076:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17858:x1875967130926720:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10489us (13941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062083.774086:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789062083.774136:0:17858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd347100 x1875967130926720/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789062099 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062083.774151:0:17858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd347100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1875967130926720:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789062083.774163:0:17858:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789062083.774201:0:17858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1875967130926848:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789062083.774245:0:17858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062083.774265:0:17858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab0540 going to sleep for 11 seconds 00000100:00100000:1.0:1789062083.774281:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130926848 00000100:00100000:1.0:1789062083.774286:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130926848 00000100:00100000:1.0:1789062083.774322:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789062083.774330:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17858:x1875967130926848:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789062083.774354:0:18621:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789062083.774384:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17858:x1875967130926848:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062083.774401:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789062083.774427:0:17858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c8171f80 x1875967130926848/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789062099 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062083.774437:0:17858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1875967130926848:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789062083.774445:0:17858:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789062083.774466:0:17858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1875967130926976:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789062083.774487:0:17858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062083.774501:0:17858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab0540 going to sleep for 11 seconds 00000100:00100000:1.0:1789062083.774512:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130926976 00000100:00100000:1.0:1789062083.774516:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130926976 00000100:00100000:1.0:1789062083.774536:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789062083.774541:0:18619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17858:x1875967130926976:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789062083.774563:0:18619:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:2.0:1789062083.776359:0:19096:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789062083.776367:0:19096:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789062083.776373:0:19096:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:2.0:1789062083.797521:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062083.797532:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7c9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.797550:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789062083.797554:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062083.797560:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7c9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.797576:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7c9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.797586:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7c9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.797594:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7c9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.797639:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789062083.799367:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062083.799378:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7ca5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.799392:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789062083.799397:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062083.799402:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7ca5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.799415:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7ca5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.799426:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7ca5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.799435:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7ca5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.799454:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789062083.799911:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789062083.799918:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7c9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.799927:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483a00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.799937:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7c9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.799947:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7c9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.799964:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7c9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.799973:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7c9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.799993:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789062083.799997:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7ca5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.800003:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.800006:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7ca5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.800013:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7ca5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.800020:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7ca5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.800027:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7ca5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.800044:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.800045:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.800047:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.800053:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789062083.800362:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062083.800368:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7cac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.800378:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789062083.800381:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062083.800386:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7cac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.800396:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7cac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.800405:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7cac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.800413:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7cac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.800465:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789062083.801535:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062083.801544:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.801567:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789062083.801570:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062083.801576:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.801587:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.801596:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.801618:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.802715:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789062083.802725:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7cac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.802736:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483c00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789062083.802740:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7cac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.802749:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7cac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.802771:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7cac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.802785:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7cac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.802806:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789062083.802810:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.802817:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1482c00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789062083.802820:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.802828:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.802854:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cb3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.802863:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062083.802865:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062083.802866:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.805949:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789062083.805964:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.806525:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789062083.807724:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062083.807734:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.807749:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789062083.807754:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062083.807760:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.807784:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.807794:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.807802:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.807821:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789062083.807828:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789062083.807835:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.807913:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789062083.807922:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.807930:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.807946:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.807952:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062083.807968:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062083.807970:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789062083.807972:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789062083.808126:0:19436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789062083.808138:0:19436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789062083.808142:0:19436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1789062083.808292:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789062083.808299:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7cc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.808308:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1789062083.808311:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789062083.808315:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7cc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.808337:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7cc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.808345:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7cc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.808352:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7cc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.808366:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789062083.808462:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062083.808471:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7cc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.808479:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c8198e00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062083.808482:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7cc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.808490:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7cc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.808502:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7cc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.808509:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2275c62/0x2774d8f311dc7cc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.808528:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062083.808530:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062083.808532:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789062083.808686:0:18619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17858:x1875967130926976:12345-0@lo:5:osp-pre-1-1.0 Request processed in 34141us (34194us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789062083.808695:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789062083.808858:0:17858:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789062083.808869:0:17858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1875967130926976:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789062083.808884:0:17858:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789062083.808935:0:17858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd345180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17858:1875967130927104:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789062083.808972:0:17858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062083.808992:0:17858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789062083.809336:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130927104 00000100:00100000:2.0:1789062083.809343:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130927104 00000100:00100000:2.0:1789062083.809416:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789062083.809425:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17858:x1875967130927104:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789062083.809474:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17858:x1875967130927104:12345-0@lo:900:osp-pre-1-1.0 Request processed in 50us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062083.809480:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789062083.809484:0:17858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd345180 x1875967130927104/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789062099 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062083.809495:0:17858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd345180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17858:1875967130927104:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1789062083.809973:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062083.809981:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7cc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.809992:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789062083.810003:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062083.810009:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7cc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.810021:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7cc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.810030:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7cc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.810038:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7cc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.810088:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789062083.810529:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062083.810535:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7ccf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.810544:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789062083.810547:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062083.810552:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7ccf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.810561:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7ccf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.810570:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7ccf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.810584:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7ccf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.810628:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789062083.810635:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7cc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.810643:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062083.810647:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7cc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.810656:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7cc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.810672:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7cc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.810680:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b155fa25/0x2774d8f311dc7cc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.810701:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062083.810704:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7ccf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.810710:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483a00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062083.810713:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7ccf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.810720:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7ccf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.810729:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7ccf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.810735:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062083.810736:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062083.810738:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.812211:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789062083.812221:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095d62a6d/0x2774d8f311dc7ccf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.812438:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789062083.812666:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062083.812673:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.812685:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789062083.812689:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062083.812695:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.812707:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.812717:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.812725:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.812751:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789062083.812885:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062083.812892:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.812900:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1482c00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062083.812905:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.812925:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.812941:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.812949:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6c9db96/0x2774d8f311dc7cd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.812963:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062083.812965:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062083.812967:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789062083.813062:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062083.813068:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cdd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813076:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789062083.813079:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062083.813083:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813091:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813099:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813107:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813122:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789062083.813240:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062083.813245:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.813253:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062083.813256:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.813264:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.813275:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cdd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.813294:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d352480/0x2774d8f311dc7cdd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.813308:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062083.813309:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062083.813311:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789062083.813381:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062083.813387:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7ce4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813395:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789062083.813403:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062083.813408:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7ce4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813418:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7ce4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813426:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7ce4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813434:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7ce4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813451:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789062083.813481:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789062083.813485:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7ce4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.813493:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483c00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:0.0:1789062083.813496:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7ce4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.813504:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7ce4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.813556:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7ce4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.813564:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b348ff84/0x2774d8f311dc7ce4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062083.813577:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062083.813578:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062083.813580:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789062083.813924:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789062083.813930:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4ed5939/0x2774d8f311dc7ceb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813939:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789062083.813941:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062083.813945:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4ed5939/0x2774d8f311dc7ceb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813954:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4ed5939/0x2774d8f311dc7ceb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813962:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4ed5939/0x2774d8f311dc7ceb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813974:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4ed5939/0x2774d8f311dc7ceb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.813993:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789062083.814022:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789062083.814028:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4ed5939/0x2774d8f311dc7ceb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.814035:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5770800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789062083.814039:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4ed5939/0x2774d8f311dc7ceb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.814047:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4ed5939/0x2774d8f311dc7ceb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.814061:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4ed5939/0x2774d8f311dc7ceb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.814069:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4ed5939/0x2774d8f311dc7ceb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.814084:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062083.814086:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062083.814087:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789062083.815981:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.816000:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6a2595a/0x2774d8f311dc7cf2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816014:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.816018:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.816023:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a2595a/0x2774d8f311dc7cf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816036:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6a2595a/0x2774d8f311dc7cf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816047:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6a2595a/0x2774d8f311dc7cf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816056:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a2595a/0x2774d8f311dc7cf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816080:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789062083.816417:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.816424:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2625fe7/0x2774d8f311dc7cf9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816432:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.816436:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.816440:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2625fe7/0x2774d8f311dc7cf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816450:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2625fe7/0x2774d8f311dc7cf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816464:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2625fe7/0x2774d8f311dc7cf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816471:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2625fe7/0x2774d8f311dc7cf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816484:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789062083.816493:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789062083.816498:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6a2595a/0x2774d8f311dc7cf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816506:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807ac00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789062083.816510:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6a2595a/0x2774d8f311dc7cf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816520:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6a2595a/0x2774d8f311dc7cf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816535:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6a2595a/0x2774d8f311dc7cf2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816543:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6a2595a/0x2774d8f311dc7cf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816558:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789062083.816567:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2625fe7/0x2774d8f311dc7cf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816574:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789062083.816577:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2625fe7/0x2774d8f311dc7cf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816585:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2625fe7/0x2774d8f311dc7cf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816596:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2625fe7/0x2774d8f311dc7cf9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816603:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2625fe7/0x2774d8f311dc7cf9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816635:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062083.816637:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.816638:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062083.816639:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789062083.816976:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.816982:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e671ba4a/0x2774d8f311dc7d00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.816992:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.816995:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.816999:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e671ba4a/0x2774d8f311dc7d00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817020:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e671ba4a/0x2774d8f311dc7d00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817030:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e671ba4a/0x2774d8f311dc7d00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817037:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e671ba4a/0x2774d8f311dc7d00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817056:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789062083.817320:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.817327:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc7d07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817335:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.817338:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.817342:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc7d07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817351:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc7d07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817359:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc7d07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817376:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc7d07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817390:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789062083.817398:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789062083.817402:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e671ba4a/0x2774d8f311dc7d00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817409:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807aa00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789062083.817412:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e671ba4a/0x2774d8f311dc7d00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817421:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e671ba4a/0x2774d8f311dc7d00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817432:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e671ba4a/0x2774d8f311dc7d00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817440:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e671ba4a/0x2774d8f311dc7d00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817452:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789062083.817455:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc7d07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817472:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789062083.817476:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc7d07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817484:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc7d07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817493:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc7d07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817501:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005921a600/0x2774d8f311dc7d07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817511:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062083.817513:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062083.817514:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.817636:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789062083.817818:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.817824:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b7845bf/0x2774d8f311dc7d0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817834:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.817851:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.817856:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b7845bf/0x2774d8f311dc7d0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817866:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b7845bf/0x2774d8f311dc7d0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817881:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b7845bf/0x2774d8f311dc7d0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817889:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b7845bf/0x2774d8f311dc7d0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.817907:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789062083.818248:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.818254:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e218913/0x2774d8f311dc7d15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.818263:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.818266:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.818271:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e218913/0x2774d8f311dc7d15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.818281:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e218913/0x2774d8f311dc7d15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.818289:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e218913/0x2774d8f311dc7d15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.818297:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e218913/0x2774d8f311dc7d15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.818319:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789062083.818590:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.818596:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc7d1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.818634:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.818638:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.818642:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc7d1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.818652:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc7d1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.818660:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc7d1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.818667:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc7d1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.818676:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789062083.818961:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.818967:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f035b8ec/0x2774d8f311dc7d23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.818975:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.818983:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.818987:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f035b8ec/0x2774d8f311dc7d23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.818997:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f035b8ec/0x2774d8f311dc7d23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819002:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789062083.819005:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f035b8ec/0x2774d8f311dc7d23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819008:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b7845bf/0x2774d8f311dc7d0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.819012:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f035b8ec/0x2774d8f311dc7d23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819016:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807bc00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.819020:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b7845bf/0x2774d8f311dc7d0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.819021:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789062083.819029:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b7845bf/0x2774d8f311dc7d0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819043:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b7845bf/0x2774d8f311dc7d0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819051:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b7845bf/0x2774d8f311dc7d0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819065:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789062083.819069:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e218913/0x2774d8f311dc7d15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819081:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807ba00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.819084:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e218913/0x2774d8f311dc7d15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819092:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e218913/0x2774d8f311dc7d15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819103:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e218913/0x2774d8f311dc7d15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819109:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e218913/0x2774d8f311dc7d15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819121:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789062083.819125:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc7d1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819131:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a200 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.819134:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc7d1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819141:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc7d1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819151:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc7d1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819165:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000101642c4/0x2774d8f311dc7d1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819178:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789062083.819181:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f035b8ec/0x2774d8f311dc7d23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819188:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a000 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.819192:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f035b8ec/0x2774d8f311dc7d23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819199:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f035b8ec/0x2774d8f311dc7d23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819209:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f035b8ec/0x2774d8f311dc7d23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819217:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f035b8ec/0x2774d8f311dc7d23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.819228:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.819230:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.819232:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.819239:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789062083.819291:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.819297:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc7d2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.819305:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.819308:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.819311:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc7d2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.819320:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc7d2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.819328:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc7d2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.819340:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc7d2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.819353:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789062083.819954:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.819961:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b145db65/0x2774d8f311dc7d31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.819970:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.819973:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.819977:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b145db65/0x2774d8f311dc7d31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.819986:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b145db65/0x2774d8f311dc7d31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.819994:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b145db65/0x2774d8f311dc7d31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.820001:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b145db65/0x2774d8f311dc7d31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.820013:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789062083.820966:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.820974:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074adcc23/0x2774d8f311dc7d38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.820990:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.820993:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.820997:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074adcc23/0x2774d8f311dc7d38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821008:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074adcc23/0x2774d8f311dc7d38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821017:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074adcc23/0x2774d8f311dc7d38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821024:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074adcc23/0x2774d8f311dc7d38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821032:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789062083.821293:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.821298:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba7a56ec/0x2774d8f311dc7d3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821306:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.821309:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.821313:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba7a56ec/0x2774d8f311dc7d3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821322:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba7a56ec/0x2774d8f311dc7d3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821340:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba7a56ec/0x2774d8f311dc7d3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821347:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba7a56ec/0x2774d8f311dc7d3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821355:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789062083.821671:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.821676:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a900fc98/0x2774d8f311dc7d46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821684:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.821687:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.821691:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900fc98/0x2774d8f311dc7d46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821700:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a900fc98/0x2774d8f311dc7d46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821708:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a900fc98/0x2774d8f311dc7d46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821715:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a900fc98/0x2774d8f311dc7d46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.821732:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789062083.826419:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.826432:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc7d4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.826449:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.826453:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.826459:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc7d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.826473:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc7d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.826484:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc7d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.826492:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc7d4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.826505:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1789062083.827076:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789062083.827085:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc7d2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827099:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807ae00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.827104:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc7d2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827114:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc7d2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827131:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc7d2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827139:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9563c3a/0x2774d8f311dc7d2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827160:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789062083.827163:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b145db65/0x2774d8f311dc7d31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827168:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b000 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.827172:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b145db65/0x2774d8f311dc7d31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827179:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b145db65/0x2774d8f311dc7d31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827188:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b145db65/0x2774d8f311dc7d31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827200:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b145db65/0x2774d8f311dc7d31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827214:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789062083.827217:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074adcc23/0x2774d8f311dc7d38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827224:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf200 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.827227:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074adcc23/0x2774d8f311dc7d38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827235:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074adcc23/0x2774d8f311dc7d38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827244:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074adcc23/0x2774d8f311dc7d38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827251:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074adcc23/0x2774d8f311dc7d38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827263:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789062083.827267:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba7a56ec/0x2774d8f311dc7d3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827273:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cec00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.827280:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba7a56ec/0x2774d8f311dc7d3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827289:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba7a56ec/0x2774d8f311dc7d3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827299:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba7a56ec/0x2774d8f311dc7d3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827307:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba7a56ec/0x2774d8f311dc7d3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827320:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789062083.827323:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a900fc98/0x2774d8f311dc7d46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827330:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce200 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.827333:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a900fc98/0x2774d8f311dc7d46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827341:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a900fc98/0x2774d8f311dc7d46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827350:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a900fc98/0x2774d8f311dc7d46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827356:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a900fc98/0x2774d8f311dc7d46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827371:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789062083.827375:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc7d4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827381:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.827384:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc7d4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827391:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc7d4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827399:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc7d4d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827405:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9183a38/0x2774d8f311dc7d4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.827416:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.827418:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.827420:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.827426:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789062083.828134:0:19096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789062083.828142:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc7d54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.828154:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789062083.828163:0:19096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062083.828169:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc7d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.828181:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc7d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.828190:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc7d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.828197:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc7d54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062083.828228:0:19096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789062083.828285:0:19096:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1789062083.828368:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17142:x1875967130926464:12345-0@lo:5:osp-pre-1-0.0 Request processed in 68715us (68831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062083.828378:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789062083.828517:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd346680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17142:1875967130926464:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789062083.828532:0:17142:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1789062083.828573:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17142:1875967130927232:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789062083.828633:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062083.828659:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab03c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789062083.829321:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789062083.829328:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc7d54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.829337:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062083.829351:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc7d54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.829360:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc7d54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.829376:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc7d54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.829382:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f03f1df/0x2774d8f311dc7d54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062083.829402:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.829403:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062083.829404:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062083.829499:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130927232 00000100:00100000:3.0:1789062083.829506:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130927232 00000100:00100000:3.0:1789062083.829544:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789062083.829553:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17142:x1875967130927232:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789062083.829588:0:18621:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1789062083.833133:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17142:x1875967130927232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3574us (4493us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789062083.833146:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789062083.833215:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17142:1875967130927232:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789062083.833236:0:17142:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000040:00080000:3.0:1789062084.079597:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1789062084.548553:0:19791:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789062084.651999:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789062085.534088:0:19843:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789062085.534284:0:19843:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789062085.674524:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789062086.543457:0:19893:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789062086.543888:0:19893:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789062086.705940:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062086.813174:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062086.814884:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120359936 00000100:00100000:1.0:1789062086.814896:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120359936 00000100:00100000:1.0:1789062086.814952:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:1.0:1789062086.814961:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2389:x1875967120359936:12345-192.168.203.3@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789062086.814988:0:17109:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8094d664-afc8-4820-b5e6-f6352ebb9a04@192.168.203.3@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:1.0:1789062086.815017:0:17109:0:(genops.c:1384:class_connect()) connect: client 8094d664-afc8-4820-b5e6-f6352ebb9a04, cookie 0x2774d8f311dc7d5b 00000100:00080000:1.0:1789062086.815151:0:17109:0:(import.c:65:import_set_state_nolock()) ffff9766c754d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789062086.815240:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+5:2389:x1875967120359936:12345-192.168.203.3@tcp:250:mount.lustre.0 Request processed in 277us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062086.815247:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:1.0:1789062086.822335:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062086.824587:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120360064 00000100:00100000:0.0:1789062086.824600:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120360064 00000100:00100000:0.0:1789062086.824731:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:0.0:1789062086.824742:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+5:14864:x1875967120360064:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789062086.824759:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062086.824777:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8198e00/0x2774d8f311dc7d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bc08 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062086.824804:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8198e00/0x2774d8f311dc7d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc08 expref: 6 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062086.824816:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8198e00/0x2774d8f311dc7d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc08 expref: 6 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062086.824837:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198e00, rc 0) 00000100:00100000:0.0:1789062086.824903:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+6:14864:x1875967120360064:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 163us (2575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062086.824911:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:2.0:1789062086.838069:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062086.839763:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789062086.839782:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c83e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130927360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789062086.839849:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062086.839891:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130927360 00000100:00100000:3.0:1789062086.839899:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130927360 00000100:00100000:3.0:1789062086.839946:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789062086.839954:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130927360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789062086.839979:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789062086.840016:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130927360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062086.840022:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789062086.840039:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789062086.840069:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c83e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130927360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789062086.850406:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120360192 00000100:00100000:1.0:1789062086.850513:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120360192 00000100:00100000:1.0:1789062086.850579:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:1.0:1789062086.850589:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+6:14864:x1875967120360192:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789062086.850885:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+6:14864:x1875967120360192:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 297us (12823us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789062086.850894:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:1.0:1789062086.862036:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062086.863465:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120360320 00000100:00100000:2.0:1789062086.863478:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120360320 00000100:00100000:2.0:1789062086.863547:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:2.0:1789062086.863560:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+6:14864:x1875967120360320:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789062086.863577:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062086.863595:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c5771c00/0x2774d8f311dc7d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bc0f expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062086.864015:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c5771c00/0x2774d8f311dc7d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc0f expref: 7 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062086.864043:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c5771c00/0x2774d8f311dc7d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc0f expref: 7 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062086.864053:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5771c00, rc 0) 00000100:00100000:2.0:1789062086.864157:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+7:14864:x1875967120360320:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 599us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062086.864164:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:2.0:1789062086.869779:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062086.871377:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120360448 00000100:00100000:3.0:1789062086.871391:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120360448 00000100:00100000:3.0:1789062086.871459:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:3.0:1789062086.871470:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+7:14864:x1875967120360448:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789062086.871979:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+8:14864:x1875967120360448:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 509us (2215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062086.871988:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:3.0:1789062086.880223:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062086.880313:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120360576 00000100:00100000:0.0:1789062086.880323:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120360576 00000100:00100000:0.0:1789062086.880374:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:0.0:1789062086.880385:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+8:14864:x1875967120360576:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789062086.880540:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+8:14864:x1875967120360576:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 156us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062086.880548:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:1.0:1789062086.900039:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062086.900236:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120360704 00000100:00100000:3.0:1789062086.900246:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120360704 00000100:00100000:3.0:1789062086.900310:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:3.0:1789062086.900319:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+8:14883:x1875967120360704:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789062086.900449:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+8:14883:x1875967120360704:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 131us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062086.900457:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:1.0:1789062086.949292:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062086.949391:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120360832 00000100:00100000:2.0:1789062086.949401:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120360832 00000100:00100000:2.0:1789062086.949454:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:2.0:1789062086.949464:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+8:14883:x1875967120360832:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789062086.949650:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+8:14883:x1875967120360832:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 186us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062086.949658:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:2.0:1789062086.960736:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062086.961122:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120360960 00000100:00100000:0.0:1789062086.961131:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120360960 00000100:00100000:0.0:1789062086.961183:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:0.0:1789062086.961193:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+8:14883:x1875967120360960:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789062086.961342:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+8:14883:x1875967120360960:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 151us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062086.961350:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:1.0:1789062086.963790:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062086.963907:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120361088 00000100:00100000:3.0:1789062086.963917:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120361088 00000100:00100000:3.0:1789062086.963966:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:3.0:1789062086.963976:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+8:14864:x1875967120361088:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789062086.963993:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062086.964012:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7d70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bc40 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062086.964040:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc40 expref: 9 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062086.964052:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c80ce000/0x2774d8f311dc7d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc40 expref: 9 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062086.964061:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce000, rc 0) 00000100:00100000:3.0:1789062086.964112:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+9:14864:x1875967120361088:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 137us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062086.964119:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:1.0:1789062086.967877:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062086.968064:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120361216 00000100:00100000:2.0:1789062086.968074:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120361216 00000100:00100000:2.0:1789062086.968129:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:2.0:1789062086.968139:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+9:14864:x1875967120361216:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789062086.968179:0:17109:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789062086.968212:0:17109:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789062086.968217:0:17109:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789062086.968220:0:17109:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789062086.968223:0:17109:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789062086.968230:0:17109:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789062086.979705:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+9:14864:x1875967120361216:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 11556us (11826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062086.979720:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:1.0:1789062086.985911:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062086.986017:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120361344 00000100:00100000:0.0:1789062086.986027:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120361344 00000100:00100000:0.0:1789062086.986084:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:0.0:1789062086.986094:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+9:14864:x1875967120361344:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789062086.986110:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062086.986128:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8198200/0x2774d8f311dc7d77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bc47 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062086.986171:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8198200/0x2774d8f311dc7d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc47 expref: 10 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062086.986183:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8198200/0x2774d8f311dc7d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc47 expref: 10 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062086.986192:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8198200, rc 0) 00000100:00100000:0.0:1789062086.986254:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+10:14864:x1875967120361344:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 162us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062086.986262:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:2.0:1789062086.999484:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062087.000411:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120361472 00000100:00100000:1.0:1789062087.000425:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120361472 00000100:00100000:1.0:1789062087.000496:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:1.0:1789062087.000507:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c3f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+10:14864:x1875967120361472:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789062087.000708:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c3f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+10:14864:x1875967120361472:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 202us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062087.000716:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:2.0:1789062087.006032:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062087.006143:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120361600 00000100:00100000:3.0:1789062087.006161:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120361600 00000100:00100000:3.0:1789062087.006266:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:3.0:1789062087.006280:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+10:14864:x1875967120361600:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789062087.006491:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdbcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+10:14864:x1875967120361600:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 214us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062087.006500:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:3.0:1789062087.009192:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062087.009327:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120361728 00000100:00100000:0.0:1789062087.009340:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120361728 00000100:00100000:0.0:1789062087.009407:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:0.0:1789062087.009435:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+10:14889:x1875967120361728:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789062087.009677:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdbcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+10:14889:x1875967120361728:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 242us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062087.009686:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:2.0:1789062087.015840:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062087.016000:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120361856 00000100:00100000:1.0:1789062087.016010:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120361856 00000100:00100000:1.0:1789062087.016073:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:1.0:1789062087.016083:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+10:14889:x1875967120361856:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789062087.016257:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdbcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+10:14889:x1875967120361856:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 175us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062087.016265:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:2.0:1789062087.027586:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062087.028008:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120361984 00000100:00100000:0.0:1789062087.028019:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120361984 00000100:00100000:0.0:1789062087.028110:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1789062087.028117:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875967120361984:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789062087.028147:0:17116:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1b10d670-7f0f-4a11-9d02-f894398913c8@192.168.203.3@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:0.0:1789062087.028209:0:17116:0:(genops.c:1384:class_connect()) connect: client 1b10d670-7f0f-4a11-9d02-f894398913c8, cookie 0x2774d8f311dc7d7e 00000004:00100000:0.0:1789062087.028237:0:17116:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1789062087.028436:0:17116:0:(import.c:65:import_set_state_nolock()) ffff9767eb929000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789062087.028521:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2389:x1875967120361984:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 402us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062087.028529:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:3.0:1789062087.035176:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062087.036484:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120362240 00000100:00100000:0.0:1789062087.036499:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120362240 00000100:00100000:0.0:1789062087.036553:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:0.0:1789062087.036562:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2389:x1875967120362240:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789062087.036594:0:17115:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 1b10d670-7f0f-4a11-9d02-f894398913c8@192.168.203.3@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:0.0:1789062087.036686:0:17115:0:(genops.c:1384:class_connect()) connect: client 1b10d670-7f0f-4a11-9d02-f894398913c8, cookie 0x2774d8f311dc7d85 00000004:00100000:0.0:1789062087.036709:0:17115:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1789062087.036929:0:17115:0:(import.c:65:import_set_state_nolock()) ffff9767eb92f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789062087.037015:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2389:x1875967120362240:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 452us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062087.037041:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:1.0:1789062087.041385:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062087.041436:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062087.041570:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062087.042208:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120362496 00000100:00100000:0.0:1789062087.042208:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120362368 00000100:00100000:3.0:1789062087.042218:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120362496 00000100:00100000:0.0:1789062087.042218:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120362368 00000100:00100000:0.0:1789062087.042278:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120362112 00000100:00100000:0.0:1789062087.042282:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120362112 00000100:00100000:0.0:1789062087.042297:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:0.0:1789062087.042306:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+6:0:x1875967120362368:12345-192.168.203.3@tcp:41:mount.lustre.0 00000100:00080000:1.0:1789062087.042331:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789062087.042335:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1789062087.042343:0:17116:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789062087.042441:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+6:0:x1875967120362368:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 135us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062087.042448:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:0.0:1789062087.042465:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1789062087.042472:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+7:0:x1875967120362112:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789062087.042489:0:17116:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789062087.042524:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+7:0:x1875967120362112:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 53us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062087.042530:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:0.0:1789062087.042542:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1789062087.042548:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c748ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14864:x1875967120362496:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789062087.042557:0:17116:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789062087.042582:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c748ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14864:x1875967120362496:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 34us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062087.042588:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:3.0:1789062087.057921:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062087.059072:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120362624 00000100:00100000:0.0:1789062087.059105:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120362624 00000100:00100000:0.0:1789062087.059192:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:0.0:1789062087.059202:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14864:x1875967120362624:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789062087.059302:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14864:x1875967120362624:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 102us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062087.059310:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1789062087.061502:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062087.061555:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062087.061692:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120363008 00000100:00100000:0.0:1789062087.061705:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120363008 00000100:00100000:0.0:1789062087.061781:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1789062087.061792:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14864:x1875967120363008:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789062087.062055:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14864:x1875967120363008:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 262us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062087.062065:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:1.0:1789062087.062324:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120362752 00000100:00100000:1.0:1789062087.062330:0:19396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120362752 00000100:00100000:1.0:1789062087.062427:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1789062087.062433:0:19396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1875967120362752:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789062087.062472:0:19396:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1b10d670-7f0f-4a11-9d02-f894398913c8@192.168.203.3@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:1.0:1789062087.062514:0:19396:0:(genops.c:1384:class_connect()) connect: client 1b10d670-7f0f-4a11-9d02-f894398913c8, cookie 0x2774d8f311dc7d8c 00002000:00100000:1.0:1789062087.062548:0:19396:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1b10d670-7f0f-4a11-9d02-f894398913c8/ffff9766c7548800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789062087.062565:0:19396:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1789062087.062857:0:19396:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789062087.062898:0:19396:0:(import.c:65:import_set_state_nolock()) ffff9766c754f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789062087.063213:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062087.068333:0:19396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2389:x1875967120362752:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 5876us (6755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062087.068354:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:3.0:1789062087.072403:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062087.072441:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120362880 00000100:00100000:2.0:1789062087.072458:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120362880 00000100:00100000:2.0:1789062087.072535:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1789062087.072546:0:18619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875967120362880:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789062087.072596:0:18619:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1b10d670-7f0f-4a11-9d02-f894398913c8@192.168.203.3@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1789062087.072665:0:18619:0:(genops.c:1384:class_connect()) connect: client 1b10d670-7f0f-4a11-9d02-f894398913c8, cookie 0x2774d8f311dc7d93 00002000:00100000:2.0:1789062087.072682:0:18619:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1b10d670-7f0f-4a11-9d02-f894398913c8/ffff9766c6150000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789062087.072707:0:18619:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1789062087.073043:0:18619:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789062087.073079:0:18619:0:(import.c:65:import_set_state_nolock()) ffff9766c6153800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789062087.073846:0:18619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2389:x1875967120362880:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 1296us (10628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062087.073859:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:1.0:1789062087.074034:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120363136 00000100:00100000:1.0:1789062087.074043:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120363136 00000100:00100000:1.0:1789062087.074094:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:1.0:1789062087.074102:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14864:x1875967120363136:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789062087.079316:0:17118:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5004us 00000004:00200000:1.0:1789062087.090648:0:17118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789062087.090850:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14864:x1875967120363136:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 16738us (18451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062087.090862:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1789062087.270014:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062087.272225:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120363264 00000100:00100000:0.0:1789062087.272243:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120363264 00000100:00100000:0.0:1789062087.272354:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1789062087.272367:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14912:x1875967120363264:12345-192.168.203.3@tcp:101:mkdir.0 00010000:00010000:0.0:1789062087.272402:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062087.272437:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc7d9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bc78 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062087.272525:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7da1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062087.272542:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062087.272560:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789062087.272677:0:17116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789062087.272681:0:17116:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789062087.272727:0:17116:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062087.272759:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199200/0x2774d8f311dc7d9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc78 expref: 8 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062087.272785:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7da1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc78 expref: 7 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062087.272795:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d6acc400) 00010000:00010000:0.0:1789062087.272798:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789062087.272802:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199800, rc 0) 00000100:00100000:0.0:1789062087.273115:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+7:14912:x1875967120363264:12345-192.168.203.3@tcp:101:mkdir.0 Request processed in 750us (3114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062087.273125:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1789062087.338265:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789062087.338295:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130927616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789062087.338387:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062087.338447:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130927616 00000100:00100000:0.0:1789062087.338457:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130927616 00000100:00100000:0.0:1789062087.338511:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789062087.338522:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130927616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789062087.338556:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789062087.338630:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130927616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062087.338659:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789062087.338785:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130927616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789062087.338977:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789062087.338989:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130927488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789062087.339023:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062087.339146:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130927488 00000100:00100000:0.0:1789062087.339151:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130927488 00000100:00100000:0.0:1789062087.339186:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789062087.339193:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130927488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789062087.339208:0:17121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789062087.339294:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130927488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062087.339301:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789062087.346458:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130927488:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789062087.722209:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062087.853347:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789062087.853369:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130927744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789062087.853438:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062087.853570:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130927744 00000100:00100000:0.0:1789062087.853578:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130927744 00000100:00100000:0.0:1789062087.853654:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789062087.853664:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130927744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789062087.853685:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789062087.853736:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130927744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062087.853743:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789062087.853864:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789062087.853988:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130927744:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789062088.426655:0:17867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789062088.745890:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062088.873870:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c7513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130927872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789062088.873942:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062088.874064:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130927872 00000100:00100000:1.0:1789062088.874072:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130927872 00000100:00100000:1.0:1789062088.874136:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789062088.874147:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130927872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789062088.874167:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789062088.874209:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130927872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062088.874215:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789062088.874312:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789062088.874344:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c7513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130927872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789062088.875382:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130928000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789062088.875426:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062088.875568:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130928000 00000100:00100000:3.0:1789062088.875575:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130928000 00000100:00100000:3.0:1789062088.875649:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789062088.875656:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875967130928000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789062088.875684:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789062088.875732:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875967130928000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062088.875739:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789062088.875901:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130928000:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789062088.875906:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789062088.876178:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130928512:0@lo:400:kworker.0 00000100:00100000:2.0:1789062088.876220:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062088.876246:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130929024:0@lo:400:kworker.0 00000100:00100000:2.0:1789062088.876269:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062088.876286:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789062088.876291:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130928384:0@lo:400:kworker.0 00000100:00100000:2.0:1789062088.876312:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062088.876327:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130928896:0@lo:400:kworker.0 00000100:00100000:2.0:1789062088.876343:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062088.876625:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130928256:0@lo:400:kworker.0 00000100:00100000:0.0:1789062088.876655:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062088.876666:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130928384 00000100:00100000:1.0:1789062088.876672:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130928384 00000100:00100000:0.0:1789062088.876681:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130928768:0@lo:400:kworker.0 00000100:00100000:0.0:1789062088.876701:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062088.876702:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789062088.876709:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130928384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062088.876725:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130929280:0@lo:400:kworker.0 00000100:00100000:1.0:1789062088.876745:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd516680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130928384:12345-0@lo:400:kworker.0 Request processed in 36us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062088.876751:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789062088.876752:0:18432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130928256 00000100:00100000:1.0:1789062088.876763:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130928768 00000100:00100000:1.0:1789062088.876766:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130928768 00000100:00100000:0.0:1789062088.876767:0:18432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130928256 00000100:00100000:1.0:1789062088.876790:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789062088.876790:0:18432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789062088.876796:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130928768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062088.876796:0:18432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130928256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062088.876843:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130928768:12345-0@lo:400:kworker.0 Request processed in 46us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062088.876849:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789062088.876880:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789062088.877068:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130928128:0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.877100:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062088.877123:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130928640:0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.877143:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062088.877159:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130929152:0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.877183:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130928128 00000100:00100000:3.0:1789062088.877186:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130928128 00000100:00100000:3.0:1789062088.877211:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789062088.877217:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fdbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:3622:x1875967130928128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.877249:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fdbccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:3622:x1875967130928128:12345-0@lo:400:kworker.0 Request processed in 32us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062088.877255:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789062088.877369:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130929408:0@lo:400:kworker.0 00000100:00100000:2.0:1789062088.877393:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062088.878478:0:18432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130928256:12345-0@lo:400:kworker.0 Request processed in 1676us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062088.878489:0:18432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789062088.878512:0:18432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130928640 00000100:00100000:0.0:1789062088.878518:0:18432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130928640 00000100:00100000:0.0:1789062088.878650:0:18432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789062088.878658:0:18432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130928640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789062088.878709:0:18432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130928640:12345-0@lo:400:kworker.0 Request processed in 52us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062088.878715:0:18432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789062088.885432:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130928384:0@lo:400:kworker.0 00000100:00100000:2.0:1789062088.885521:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062088.887827:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130928512 00000100:00100000:1.0:1789062088.887827:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130929024 00000100:00100000:3.0:1789062088.887839:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130928512 00000100:00100000:1.0:1789062088.887839:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130929024 00000100:00100000:3.0:1789062088.887890:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130929408 00000100:00100000:1.0:1789062088.887890:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130928896 00000100:00100000:3.0:1789062088.887895:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130929408 00000100:00100000:2.0:1789062088.887895:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130928128:0@lo:400:kworker.0 00000100:00100000:1.0:1789062088.887895:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130928896 00000100:00100000:1.0:1789062088.887911:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130929152 00000100:00100000:1.0:1789062088.887915:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130929152 00000100:00100000:2.0:1789062088.887917:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130928640:0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.887918:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789062088.887930:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130928512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062088.887931:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789062088.887938:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789062088.887980:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062088.888009:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130928512:12345-0@lo:400:kworker.0 Request processed in 79us (11787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062088.888014:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130928256:0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.888020:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789062088.888028:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130928768:0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.888040:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130929280 00000100:00100000:2.0:1789062088.888081:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130928512:0@lo:400:kworker.0 00000100:00080000:2.0:1789062088.888101:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789062088.888105:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789062088.888430:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130929280 00000100:00100000:3.0:1789062088.888469:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789062088.888475:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130929024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.888515:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875967130929024:12345-0@lo:400:kworker.0 Request processed in 39us (12245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062088.888533:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789062088.888540:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875967130929024:0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.888553:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789062088.888560:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130928896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.888601:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130928896:12345-0@lo:400:kworker.0 Request processed in 42us (12256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062088.888624:0:17116:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789062088.888625:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789062088.888639:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789062088.888649:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130929408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062088.888692:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130928896:0@lo:400:kworker.0 00000100:00100000:0.0:1789062088.888709:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130929408:12345-0@lo:400:kworker.0 Request processed in 60us (11313us total) trans 0 rc 0/0 00010000:00080000:2.0:1789062088.888714:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c4b67100 x1875967130929408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062088.888751:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130929408:0@lo:400:kworker.0 00000100:00080000:1.0:1789062088.888923:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789062088.891195:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789062088.891218:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130929152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.891321:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130929152:12345-0@lo:400:kworker.0 Request processed in 115us (5799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062088.891338:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789062088.891392:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c4b65f80 x1875967130929152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789062088.891405:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130929152:0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.891444:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789062088.891452:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130929280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062088.891488:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875967130929280:12345-0@lo:400:kworker.0 Request processed in 38us (3509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062088.891494:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789062088.891527:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875967130929280:0@lo:400:kworker.0 00000100:00100000:0.0:1789062088.892389:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789062089.296940:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062089.298642:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120363392 00000100:00100000:3.0:1789062089.298667:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120363392 00000100:00100000:3.0:1789062089.298797:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1789062089.298821:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+7:14964:x1875967120363392:12345-192.168.203.3@tcp:41:lfs.0 00000004:00000024:3.0:1789062089.298876:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789062089.299027:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+7:14964:x1875967120363392:12345-192.168.203.3@tcp:41:lfs.0 Request processed in 218us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062089.299036:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00080000:1.0:1789062089.299329:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789062089.305549:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062089.305757:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120363520 00000100:00100000:2.0:1789062089.305775:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120363520 00000100:00100000:2.0:1789062089.305893:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1789062089.305906:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14964:x1875967120363520:12345-192.168.203.3@tcp:41:lfs.0 00000004:00000024:2.0:1789062089.305955:0:17117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789062089.306062:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14964:x1875967120363520:12345-192.168.203.3@tcp:41:lfs.0 Request processed in 160us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.306069:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00080000:1.0:1789062089.306229:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789062089.310992:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062089.312054:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120363648 00000100:00100000:1.0:1789062089.312065:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120363648 00000100:00100000:1.0:1789062089.312162:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:1.0:1789062089.312172:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14964:x1875967120363648:12345-192.168.203.3@tcp:13:lfs.0 00002000:00000024:1.0:1789062089.312206:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789062089.312299:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd514a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14964:x1875967120363648:12345-192.168.203.3@tcp:13:lfs.0 Request processed in 128us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062089.312306:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00080000:2.0:1789062089.312373:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789062089.316706:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062089.316825:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120363776 00000100:00100000:1.0:1789062089.316835:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120363776 00000100:00100000:1.0:1789062089.316907:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:1.0:1789062089.316918:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14964:x1875967120363776:12345-192.168.203.3@tcp:13:lfs.0 00002000:00000024:1.0:1789062089.316949:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789062089.317036:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1b10d670-7f0f-4a11-9d02-f894398913c8+6:14964:x1875967120363776:12345-192.168.203.3@tcp:13:lfs.0 Request processed in 120us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062089.317043:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00080000:2.0:1789062089.317231:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789062089.530247:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062089.530342:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120363904 00000100:00100000:2.0:1789062089.530352:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120363904 00000100:00100000:2.0:1789062089.530408:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:2.0:1789062089.530417:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+10:14996:x1875967120363904:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789062089.530433:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062089.530451:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c5770000/0x2774d8f311dc7da8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bc7f expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062089.530499:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c5770000/0x2774d8f311dc7da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc7f expref: 11 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062089.530510:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c5770000/0x2774d8f311dc7da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc7f expref: 11 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062089.530529:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5770000, rc 0) 00000100:00100000:2.0:1789062089.530585:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:14996:x1875967120363904:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 169us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.530592:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:0.0:1789062089.539499:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062089.539641:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120364032 00000100:00100000:2.0:1789062089.539650:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120364032 00000100:00100000:2.0:1789062089.539703:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:2.0:1789062089.539712:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:14996:x1875967120364032:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789062089.539874:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:14996:x1875967120364032:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 162us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.539881:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:1.0:1789062089.542246:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062089.542326:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120364160 00000100:00100000:3.0:1789062089.542335:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120364160 00000100:00100000:3.0:1789062089.542387:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:3.0:1789062089.542396:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:14996:x1875967120364160:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789062089.542524:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:14996:x1875967120364160:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 129us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062089.542533:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:1.0:1789062089.550427:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062089.550520:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120364288 00000100:00100000:0.0:1789062089.550534:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120364288 00000100:00100000:0.0:1789062089.550592:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:0.0:1789062089.550602:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:15003:x1875967120364288:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789062089.550792:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:15003:x1875967120364288:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 190us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062089.550800:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:0.0:1789062089.582075:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062089.582236:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120364416 00000100:00100000:2.0:1789062089.582245:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120364416 00000100:00100000:2.0:1789062089.582301:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:2.0:1789062089.582312:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:15003:x1875967120364416:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789062089.582469:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:15003:x1875967120364416:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 158us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.582477:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:1.0:1789062089.588837:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062089.594902:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120364544 00000100:00100000:3.0:1789062089.594917:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120364544 00000100:00100000:3.0:1789062089.594988:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:3.0:1789062089.594998:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:15003:x1875967120364544:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789062089.595157:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd811450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:15003:x1875967120364544:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 160us (6329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062089.595164:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:1.0:1789062089.601879:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062089.601965:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120364672 00000100:00100000:0.0:1789062089.601975:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120364672 00000100:00100000:0.0:1789062089.602027:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:0.0:1789062089.602038:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:14996:x1875967120364672:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789062089.602054:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062089.602072:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c8199200/0x2774d8f311dc7daf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bcb0 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062089.602099:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c8199200/0x2774d8f311dc7daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcb0 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062089.602115:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c8199200/0x2774d8f311dc7daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcb0 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062089.602124:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c8199200, rc 0) 00000100:00100000:0.0:1789062089.602359:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd811850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+12:14996:x1875967120364672:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 321us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062089.602366:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:0.0:1789062089.613072:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062089.613551:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120364800 00000100:00100000:2.0:1789062089.613560:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120364800 00000100:00100000:2.0:1789062089.613681:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:2.0:1789062089.613692:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+12:14996:x1875967120364800:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789062089.613727:0:17109:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789062089.613749:0:17109:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789062089.613758:0:17109:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789062089.613761:0:17109:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789062089.613764:0:17109:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789062089.613766:0:17109:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1789062089.615656:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd812850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+12:14996:x1875967120364800:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 1960us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.615670:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:1.0:1789062089.622534:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062089.627532:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120364928 00000100:00100000:0.0:1789062089.627546:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120364928 00000100:00100000:0.0:1789062089.627625:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:0.0:1789062089.627635:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+12:14996:x1875967120364928:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789062089.627664:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062089.627682:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0031800/0x2774d8f311dc7db6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bcb7 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062089.627719:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031800/0x2774d8f311dc7db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcb7 expref: 13 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062089.627730:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0031800/0x2774d8f311dc7db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcb7 expref: 13 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062089.627740:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031800, rc 0) 00000100:00100000:0.0:1789062089.627812:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:14996:x1875967120364928:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 171us (5278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062089.627820:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:0.0:1789062089.631962:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062089.632041:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120365056 00000100:00100000:2.0:1789062089.632050:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120365056 00000100:00100000:2.0:1789062089.632102:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:2.0:1789062089.632111:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:14996:x1875967120365056:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789062089.632267:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:14996:x1875967120365056:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 157us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.632275:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:1.0:1789062089.637148:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062089.637272:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120365184 00000100:00100000:3.0:1789062089.637283:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120365184 00000100:00100000:3.0:1789062089.637350:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:3.0:1789062089.637360:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:14996:x1875967120365184:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789062089.637500:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:14996:x1875967120365184:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 141us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062089.637508:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:1.0:1789062089.646737:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062089.647271:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120365312 00000100:00100000:0.0:1789062089.647282:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120365312 00000100:00100000:0.0:1789062089.647340:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:0.0:1789062089.647351:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:15008:x1875967120365312:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789062089.647503:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:15008:x1875967120365312:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 154us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062089.647510:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:0.0:1789062089.653280:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062089.653641:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120365440 00000100:00100000:2.0:1789062089.653650:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120365440 00000100:00100000:2.0:1789062089.653744:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:2.0:1789062089.653756:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:15008:x1875967120365440:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789062089.653927:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd811050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:15008:x1875967120365440:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 172us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.653934:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 144 00000100:00100000:1.0:1789062089.658718:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062089.658814:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120365568 00000100:00100000:3.0:1789062089.658822:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120365568 00000100:00100000:3.0:1789062089.658860:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1789062089.658869:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2389:x1875967120365568:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789062089.658896:0:17115:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4@192.168.203.3@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:3.0:1789062089.658932:0:17115:0:(genops.c:1384:class_connect()) connect: client bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4, cookie 0x2774d8f311dc7dbd 00000004:00100000:3.0:1789062089.658956:0:17115:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1789062089.659043:0:17115:0:(import.c:65:import_set_state_nolock()) ffff9766c83f7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789062089.659109:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:2389:x1875967120365568:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 239us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062089.659117:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:1.0:1789062089.661408:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062089.661445:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062089.661481:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062089.661506:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062089.661532:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062089.661573:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120366208 00000100:00100000:1.0:1789062089.661581:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120366208 00000100:00100000:1.0:1789062089.661645:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120366336 00000100:00100000:1.0:1789062089.661648:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120366336 00000100:00100000:1.0:1789062089.661666:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:1.0:1789062089.661675:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2390:x1875967120366208:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789062089.661734:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2390:x1875967120366208:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 60us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062089.661742:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:1.0:1789062089.661757:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:1.0:1789062089.661763:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2390:x1875967120366336:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789062089.661785:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2390:x1875967120366336:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062089.661791:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:2.0:1789062089.661952:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120365952 00000100:00100000:2.0:1789062089.661956:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120365952 00000100:00100000:2.0:1789062089.661994:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120366080 00000100:00100000:2.0:1789062089.661997:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120366080 00000100:00100000:2.0:1789062089.662008:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120365824 00000100:00100000:2.0:1789062089.662010:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120365824 00000100:00100000:2.0:1789062089.662021:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:2.0:1789062089.662034:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+7:2390:x1875967120365952:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789062089.662066:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+7:2390:x1875967120365952:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.662072:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:2.0:1789062089.662084:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:2.0:1789062089.662089:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2390:x1875967120366080:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789062089.662109:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2390:x1875967120366080:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.662114:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:2.0:1789062089.662123:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1789062089.662128:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1875967120365824:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789062089.662149:0:17117:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4@192.168.203.3@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1789062089.662181:0:17117:0:(genops.c:1384:class_connect()) connect: client bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4, cookie 0x2774d8f311dc7dc4 00000004:00100000:2.0:1789062089.662203:0:17117:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1789062089.662279:0:17117:0:(import.c:65:import_set_state_nolock()) ffff9766c6151000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789062089.662304:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:2389:x1875967120365824:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 174us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.662311:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1789062089.673303:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062089.673446:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120366464 00000100:00100000:2.0:1789062089.673456:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120366464 00000100:00100000:2.0:1789062089.673536:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:2.0:1789062089.673546:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:0:x1875967120366464:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789062089.673576:0:17117:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789062089.673675:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:0:x1875967120366464:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 130us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.673697:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00080000:1.0:1789062089.674653:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789062089.674737:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062089.674765:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062089.674834:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120365696 00000100:00100000:0.0:1789062089.674840:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120365696 00000100:00100000:0.0:1789062089.674885:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120366592 00000100:00100000:0.0:1789062089.674888:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120366592 00000100:00100000:0.0:1789062089.674920:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:0.0:1789062089.674927:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+7:0:x1875967120365696:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789062089.674945:0:19906:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789062089.674989:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+7:0:x1875967120365696:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 62us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062089.674995:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:0.0:1789062089.675008:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:0.0:1789062089.675015:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:14996:x1875967120366592:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789062089.675024:0:19906:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789062089.675044:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:14996:x1875967120366592:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062089.675050:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00080000:1.0:1789062089.675109:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789062089.677942:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062089.679480:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120366720 00000100:00100000:0.0:1789062089.679492:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120366720 00000100:00100000:0.0:1789062089.679563:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:0.0:1789062089.679573:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:14996:x1875967120366720:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789062089.679709:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:14996:x1875967120366720:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 137us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062089.679716:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:1.0:1789062089.690012:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062089.690059:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062089.690097:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062089.690477:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120366848 00000100:00100000:2.0:1789062089.690489:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120366848 00000100:00100000:2.0:1789062089.690529:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120366976 00000100:00100000:2.0:1789062089.690534:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120366976 00000100:00100000:2.0:1789062089.690557:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1789062089.690564:0:18619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875967120366848:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789062089.690603:0:18619:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4@192.168.203.3@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1789062089.690664:0:18619:0:(genops.c:1384:class_connect()) connect: client bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4, cookie 0x2774d8f311dc7dcb 00002000:00100000:2.0:1789062089.690675:0:18619:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4/ffff9766c6153000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789062089.690686:0:18619:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1789062089.690779:0:18619:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789062089.690816:0:18619:0:(import.c:65:import_set_state_nolock()) ffff9766c6152800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789062089.690889:0:18619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:2389:x1875967120366848:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 321us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.690896:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1789062089.690915:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1789062089.690919:0:18619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875967120366976:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789062089.690937:0:18619:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4@192.168.203.3@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1789062089.690953:0:18619:0:(genops.c:1384:class_connect()) connect: client bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4, cookie 0x2774d8f311dc7dd2 00002000:00100000:2.0:1789062089.690961:0:18619:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4/ffff9766c6150800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789062089.690967:0:18619:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1789062089.691030:0:18619:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789062089.691048:0:18619:0:(import.c:65:import_set_state_nolock()) ffff9767fd821000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789062089.691074:0:18619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:2389:x1875967120366976:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 153us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.691080:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:0.0:1789062089.691891:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120367104 00000100:00100000:0.0:1789062089.691900:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120367104 00000100:00100000:0.0:1789062089.691946:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1789062089.691956:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:14996:x1875967120367104:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789062089.692009:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:14996:x1875967120367104:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 56us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062089.692026:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000001:00100000:0.0:1789062089.699431:0:19436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4 00000001:00100000:0.0:1789062089.699442:0:19436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1b10d670-7f0f-4a11-9d02-f894398913c8 00000001:00080000:0.0:1789062089.699451:0:19436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1789062089.706310:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062089.706392:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120367232 00000100:00100000:0.0:1789062089.706402:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120367232 00000100:00100000:0.0:1789062089.706451:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:0.0:1789062089.706460:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:14996:x1875967120367232:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789062089.706539:0:17119:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789062089.706634:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:14996:x1875967120367232:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 175us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062089.706642:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00010000:00010000:2.0:1789062089.770155:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062089.919197:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062089.919306:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120367360 00000100:00100000:2.0:1789062089.919315:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120367360 00000100:00100000:2.0:1789062089.919374:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1789062089.919383:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:15031:x1875967120367360:12345-192.168.203.3@tcp:101:mkdir.0 00010000:00010000:2.0:1789062089.919403:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062089.919424:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7dd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bce8 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062089.919485:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7de0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062089.919500:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062089.919513:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789062089.919567:0:17117:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789062089.919571:0:17117:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789062089.919590:0:17117:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062089.919657:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7dd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bce8 expref: 8 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062089.919695:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bce8 expref: 7 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062089.919703:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d6acc400) 00010000:00010000:2.0:1789062089.919706:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789062089.919710:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5771800, rc 0) 00000100:00100000:2.0:1789062089.919931:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+7:15031:x1875967120367360:12345-192.168.203.3@tcp:101:mkdir.0 Request processed in 548us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062089.919939:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00010000:00010000:2.0:1789062090.793828:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062091.822470:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789062091.947574:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130929536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789062091.947767:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062091.948740:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130929536 00000100:00100000:1.0:1789062091.948753:0:18624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130929536 00000100:00080000:1.0:1789062091.948883:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789062091.948912:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789062091.948923:0:18624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130929536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789062091.948962:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789062091.949038:0:18624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd514700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130929536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062091.949046:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789062091.949094:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130929536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789062092.457751:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789062092.457774:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130929664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789062092.457844:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062092.457943:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130929792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789062092.457973:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062092.458013:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130929664 00000100:00100000:0.0:1789062092.458020:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130929664 00000100:00100000:0.0:1789062092.458063:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130929792 00000100:00100000:0.0:1789062092.458078:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130929792 00000100:00100000:0.0:1789062092.458098:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789062092.458106:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130929664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789062092.458148:0:17121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789062092.458201:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130929664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062092.458208:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789062092.458224:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789062092.458230:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130929792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789062092.458246:0:17121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789062092.458395:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130929792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 164us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062092.458402:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789062092.458441:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130929792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789062092.458454:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130929664:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1789062092.654772:0:19992:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789062092.843747:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062092.971025:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789062092.971048:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130929920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789062092.971279:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062092.971378:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130929920 00000100:00100000:0.0:1789062092.971386:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130929920 00000100:00100000:0.0:1789062092.971450:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789062092.971459:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130929920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789062092.971483:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789062092.971529:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130929920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062092.971535:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789062092.971577:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130929920:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789062092.971653:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1789062092.973579:0:18616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4 00000001:00100000:3.0:1789062092.973590:0:18616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1b10d670-7f0f-4a11-9d02-f894398913c8 00000001:00100000:2.0:1789062092.973985:0:17095:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4 00000001:00100000:2.0:1789062092.973993:0:17095:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1b10d670-7f0f-4a11-9d02-f894398913c8 00000001:00100000:3.0:1789062092.974860:0:17847:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4 00000001:00100000:3.0:1789062092.974868:0:17847:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1b10d670-7f0f-4a11-9d02-f894398913c8 00010000:00010000:1.0:1789062093.872066:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789062093.994723:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83f5b9c6-643c-4659-afe5-bacf144ade05:3621:1875967130930048:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.994803:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062093.994857:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130930560:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.994884:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062093.994903:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130931072:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.994921:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062093.994930:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130930048 00000100:00100000:2.0:1789062093.994939:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130930048 00000100:00100000:1.0:1789062093.994940:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130931584:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.994961:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062093.994992:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789062093.995001:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130930432:0@lo:400:kworker.0 00000100:00100000:2.0:1789062093.995007:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789062093.995028:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:3621:x1875967130930048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062093.995084:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd813850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:3621:x1875967130930048:12345-0@lo:400:kworker.0 Request processed in 59us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062093.995092:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789062093.995178:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062093.995197:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130930944:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.995217:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062093.995234:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130931456:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.995254:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062093.995281:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:83f5b9c6-643c-4659-afe5-bacf144ade05:3621:1875967130930048:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.995311:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130930176:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.995342:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062093.995364:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130930688:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.995389:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062093.995408:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130931200:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.995432:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062093.995448:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789062093.995454:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130930304:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.995489:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062093.995510:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130930816:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.995537:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062093.995556:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130931328:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.995585:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062093.995634:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130930560 00000100:00100000:1.0:1789062093.995639:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130930560 00000100:00100000:1.0:1789062093.995666:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130931072 00000100:00100000:1.0:1789062093.995669:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130931072 00000100:00100000:1.0:1789062093.995681:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130931584 00000100:00100000:1.0:1789062093.995683:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130931584 00000100:00100000:1.0:1789062093.995705:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130931456 00000100:00100000:1.0:1789062093.995708:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130931456 00000100:00100000:1.0:1789062093.995725:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130931200 00000100:00100000:1.0:1789062093.995728:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130931200 00000100:00100000:1.0:1789062093.995743:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130931328 00000100:00100000:1.0:1789062093.995745:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130931328 00000100:00100000:1.0:1789062093.995760:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789062093.995768:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130930560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.995828:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875967130930560:12345-0@lo:400:kworker.0 Request processed in 61us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062093.995834:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789062093.995848:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789062093.995855:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130931072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.995882:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875967130931072:12345-0@lo:400:kworker.0 Request processed in 28us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062093.995888:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789062093.995900:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789062093.995915:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130931584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.995948:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875967130931584:12345-0@lo:400:kworker.0 Request processed in 34us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062093.995954:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789062093.995970:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789062093.995978:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130931456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062093.995998:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875967130930560:0@lo:400:kworker.0 00000100:00100000:2.0:1789062093.996029:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875967130931072:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.996031:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875967130931456:12345-0@lo:400:kworker.0 Request processed in 53us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062093.996043:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1789062093.996051:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd5f9180 x1875967130931584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062093.996060:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789062093.996070:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130931200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062093.996080:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875967130931584:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.996110:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875967130931200:12345-0@lo:400:kworker.0 Request processed in 41us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062093.996117:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789062093.996132:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789062093.996140:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130931328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062093.996148:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875967130931456:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.996172:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875967130931328:12345-0@lo:400:kworker.0 Request processed in 33us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062093.996178:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789062093.996215:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130930432 00000100:00100000:1.0:1789062093.996219:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130930432 00000100:00100000:1.0:1789062093.996247:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130930944 00000100:00100000:1.0:1789062093.996251:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130930944 00000100:00100000:2.0:1789062093.996261:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130930304 00000100:00100000:2.0:1789062093.996267:0:19096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130930304 00000100:00100000:1.0:1789062093.996269:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130930816 00000100:00100000:1.0:1789062093.996274:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130930816 00000100:00100000:2.0:1789062093.996296:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789062093.996304:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789062093.996308:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130930432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.996317:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130930944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062093.996354:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130930432:12345-0@lo:400:kworker.0 Request processed in 49us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062093.996361:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789062093.996371:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130930944:12345-0@lo:400:kworker.0 Request processed in 57us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062093.996378:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789062093.996386:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789062093.996390:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130930304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.996407:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789062093.996416:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130930816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062093.996427:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130930304:12345-0@lo:400:kworker.0 Request processed in 40us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062093.996435:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789062093.996456:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130930816:12345-0@lo:400:kworker.0 Request processed in 39us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062093.996463:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789062093.996478:0:3621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789062093.996496:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130930176 00000100:00100000:1.0:1789062093.996501:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130930176 00000100:00100000:1.0:1789062093.996528:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130930688 00000100:00100000:1.0:1789062093.996531:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130930688 00000100:00100000:1.0:1789062093.996550:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789062093.996558:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130930176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.996597:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130930176:12345-0@lo:400:kworker.0 Request processed in 40us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062093.996622:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789062093.996640:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789062093.996648:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130930688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062093.996656:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130930432:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.996683:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875967130930688:12345-0@lo:400:kworker.0 Request processed in 36us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062093.996690:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789062093.996693:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130930944:0@lo:400:kworker.0 00000100:00080000:1.0:1789062093.996720:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789062093.996724:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789062093.996726:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789062093.996728:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789062093.996749:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130930304:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.996764:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130930816:0@lo:400:kworker.0 00010000:00080000:1.0:1789062093.996785:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767fd5fbb80 x1875967130931328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062093.996795:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875967130931328:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.996806:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130930176:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.996814:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875967130930688:0@lo:400:kworker.0 00000100:00100000:1.0:1789062093.996823:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875967130931200:0@lo:400:kworker.0 00000100:00100000:3.0:1789062093.997485:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789062093.997496:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130931712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789062093.997537:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062093.997587:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130931712 00000100:00100000:3.0:1789062093.997591:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130931712 00000100:00100000:3.0:1789062093.997652:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789062093.997659:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130931712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789062093.997683:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789062093.997730:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130931712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062093.997736:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789062093.997795:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130931712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789062093.998024:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130931840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789062093.998058:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062093.998256:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130931840 00000100:00100000:2.0:1789062093.998260:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130931840 00000100:00100000:2.0:1789062093.998293:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789062093.998305:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130931840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789062093.998317:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789062093.998357:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130931840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062093.998364:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789062093.998426:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130931840:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1789062094.328636:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789062094.893225:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062095.110872:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062095.110915:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062095.110945:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062095.110969:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062095.110987:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062095.111006:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062095.111024:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062095.111041:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062095.111063:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062095.111089:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120368000 00000100:00100000:3.0:1789062095.111097:0:19096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120368000 00000100:00100000:3.0:1789062095.111150:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120368512 00000100:00100000:3.0:1789062095.111153:0:19096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120368512 00000100:00100000:3.0:1789062095.111169:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120367872 00000100:00100000:3.0:1789062095.111171:0:19096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120367872 00000100:00100000:3.0:1789062095.111200:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120368384 00000100:00100000:3.0:1789062095.111204:0:19096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120368384 00000100:00100000:3.0:1789062095.111224:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1789062095.111231:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2393:x1875967120368000:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789062095.111300:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2393:x1875967120368000:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 69us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062095.111307:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1789062095.111326:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:3.0:1789062095.111332:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2393:x1875967120368512:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789062095.111355:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2393:x1875967120368512:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062095.111362:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:3.0:1789062095.111373:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1789062095.111380:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2393:x1875967120367872:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789062095.111401:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2393:x1875967120367872:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062095.111407:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1789062095.111418:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1789062095.111425:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2393:x1875967120368384:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789062095.111444:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2393:x1875967120368384:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062095.111450:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1789062095.111467:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120367744 00000100:00100000:3.0:1789062095.111471:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120367744 00000100:00100000:3.0:1789062095.111500:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120368256 00000100:00100000:3.0:1789062095.111503:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120368256 00000100:00100000:3.0:1789062095.111515:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120367616 00000100:00100000:3.0:1789062095.111518:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120367616 00000100:00100000:3.0:1789062095.111529:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120368128 00000100:00100000:3.0:1789062095.111532:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120368128 00000100:00100000:3.0:1789062095.111545:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1789062095.111552:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2393:x1875967120367744:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789062095.111581:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2393:x1875967120367744:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062095.111587:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1789062095.111600:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:3.0:1789062095.111633:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2393:x1875967120368256:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789062095.111657:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2393:x1875967120368256:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 51us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062095.111663:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:3.0:1789062095.111675:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:3.0:1789062095.111682:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2393:x1875967120367616:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789062095.111704:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2393:x1875967120367616:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062095.111710:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:3.0:1789062095.111721:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:3.0:1789062095.111727:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:2393:x1875967120368128:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1789062095.111748:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:2393:x1875967120368128:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062095.111775:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00080000:3.0:1789062095.111812:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789062095.111816:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789062095.111818:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789062095.111820:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789062095.112016:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120367488 00000100:00100000:2.0:1789062095.112021:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120367488 00000100:00100000:2.0:1789062095.112056:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 146 00000100:00100000:2.0:1789062095.112063:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:2393:x1875967120367488:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789062095.112100:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:2393:x1875967120367488:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 38us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062095.112106:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 146 00010000:00010000:1.0:1789062095.913883:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789062096.937724:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789062096.972865:0:20139:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe89d73aa0 20000000:00000080:0.0:1789062096.972882:0:20139:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9767df7a2800 uarg=0000000000000000 20000000:01000000:0.0:1789062096.972931:0:20139:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789062096.972936:0:20139:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789062096.972940:0:20139:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789062096.973402:0:20140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789062096.973569:0:20139:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789062096.982544:0:20139:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789062096.983366:0:20139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983386:0:20139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c1482200/0x2774d8f311dc7a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a75 expref: 23 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983394:0:20139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c807a600/0x2774d8f311dc7a8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7a83 expref: 23 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983400:0:20139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767fd47a600/0x2774d8f311dc7ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7ac2 expref: 23 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983408:0:20139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c8198c00/0x2774d8f311dc7c2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7c27 expref: 23 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983417:0:20139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766c8198200/0x2774d8f311dc7d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc47 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983423:0:20139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9767c0031800/0x2774d8f311dc7db6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcb7 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983430:0:20139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983471:0:20139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c0031800/0x2774d8f311dc7db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcb7 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983499:0:20139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9767c0031800/0x2774d8f311dc7db6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcb7 expref: 12 pid: 17108 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062096.983513:0:20139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1875967130931968:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789062096.983653:0:20139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c8198200/0x2774d8f311dc7d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc47 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983662:0:20139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766c8198200/0x2774d8f311dc7d77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc47 expref: 12 pid: 17108 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062096.983670:0:20139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1875967130932096:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789062096.983711:0:20139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c8198c00/0x2774d8f311dc7c2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7c27 expref: 23 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983720:0:20139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766c8198c00/0x2774d8f311dc7c2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7c27 expref: 23 pid: 17110 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062096.983728:0:20139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1875967130932224:0@lo:104: 00000100:00100000:0.0:1789062096.983775:0:20139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789062096.983809:0:20139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767fd47a600/0x2774d8f311dc7ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7ac2 expref: 23 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983817:0:20139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9767fd47a600/0x2774d8f311dc7ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7ac2 expref: 23 pid: 17110 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062096.983827:0:20139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6768700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1875967130932352:0@lo:104: 00000100:00100000:0.0:1789062096.983848:0:20139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789062096.983876:0:20139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766c807a600/0x2774d8f311dc7a8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7a83 expref: 23 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983885:0:20139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766c807a600/0x2774d8f311dc7a8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7a83 expref: 23 pid: 17109 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062096.983893:0:20139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c676a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1875967130932480:0@lo:104: 00000100:00100000:0.0:1789062096.983912:0:20139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789062096.983926:0:20139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9767c1482200/0x2774d8f311dc7a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2774d8f311dc7a75 expref: 23 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.983934:0:20139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9767c1482200/0x2774d8f311dc7a7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2774d8f311dc7a75 expref: 23 pid: 17109 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062096.983943:0:20139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6769c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1875967130932608:0@lo:104: 00000100:00100000:0.0:1789062096.983958:0:20139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062096.983967:0:20139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767f7e430c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789062096.985114:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130932224 00000100:00100000:2.0:1789062096.985125:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130932224 00000100:00100000:2.0:1789062096.985166:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130932352 00000100:00100000:2.0:1789062096.985169:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130932352 00000100:00100000:2.0:1789062096.985179:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130932480 00000100:00100000:2.0:1789062096.985181:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130932480 00000100:00100000:2.0:1789062096.985190:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130932608 00000100:00100000:2.0:1789062096.985193:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130932608 00000100:00100000:2.0:1789062096.985207:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789062096.985215:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+6:20139:x1875967130932224:12345-0@lo:104: 00010000:00010000:2.0:1789062096.985239:0:17098:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7c2e expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062096.985327:0:17098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789062096.985334:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+6:20139:x1875967130932224:12345-0@lo:104: Request processed in 120us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062096.985341:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789062096.985358:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789062096.985365:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+5:20139:x1875967130932352:12345-0@lo:104: 00010000:00010000:2.0:1789062096.985372:0:17098:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7ac9 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062096.985404:0:17098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789062096.985409:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+5:20139:x1875967130932352:12345-0@lo:104: Request processed in 46us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062096.985414:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789062096.985425:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789062096.985429:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+4:20139:x1875967130932480:12345-0@lo:104: 00010000:00010000:2.0:1789062096.985442:0:17098:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7a8a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062096.985467:0:17098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789062096.985471:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+4:20139:x1875967130932480:12345-0@lo:104: Request processed in 42us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062096.985477:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789062096.985488:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789062096.985493:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+3:20139:x1875967130932608:12345-0@lo:104: 00010000:00010000:2.0:1789062096.985506:0:17098:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7a7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062096.985531:0:17098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789062096.985535:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:83f5b9c6-643c-4659-afe5-bacf144ade05+3:20139:x1875967130932608:12345-0@lo:104: Request processed in 43us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062096.985540:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789062096.985559:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789062096.985565:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7c2e expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062096.985571:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b200 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:2.0:1789062096.985574:0:17104:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7c2e expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062096.985582:0:17104:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7c2e expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789062096.985588:0:17104:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7c2e expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062096.985594:0:17104:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789062096.985656:0:17104:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7c2e expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062096.985664:0:17104:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789062096.985685:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7c2e expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.985893:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789062096.986031:0:20141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789062096.986038:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7ac9 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.986044:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483e00 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789062096.986047:0:17103:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7ac9 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.986068:0:17103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7ac9 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789062096.986074:0:17103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7ac9 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789062096.986080:0:17103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789062096.986098:0:17103:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7ac9 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.986104:0:17103:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789062096.986112:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7ac9 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.986118:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1483e00/0x2774d8f311dc7ac2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7ac9 expref: -99 pid: 18615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.986152:0:17103:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789062096.986155:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7a7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.986161:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b600 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789062096.986163:0:17103:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7a7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.986170:0:17103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7a7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789062096.986177:0:17103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7a7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789062096.986181:0:17103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789062096.986193:0:17103:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.986199:0:17103:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789062096.986218:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.986224:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767fd47b600/0x2774d8f311dc7a75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.986232:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062096.986234:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062096.986235:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062096.986247:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789062096.986264:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130932992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789062096.986303:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062096.987166:0:20139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1875967130932224:0@lo:104: 00000100:00100000:0.0:1789062096.987177:0:20139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6768700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1875967130932352:0@lo:104: 00000100:00100000:0.0:1789062096.987185:0:20139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1875967130932480:0@lo:104: 00000100:00100000:0.0:1789062096.987193:0:20139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6769c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1875967130932608:0@lo:104: 00000100:00100000:0.0:1789062096.987234:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83f5b9c6-643c-4659-afe5-bacf144ade05:3620:1875967130932736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789062096.987288:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062096.987326:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789062096.987332:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8429180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83f5b9c6-643c-4659-afe5-bacf144ade05:3620:1875967130932864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789062096.987355:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062096.987396:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130932992 00000100:00100000:0.0:1789062096.987403:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130932992 00010000:00010000:0.0:1789062096.987433:0:17101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c1482200/0x2774d8f311dc7a7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7a75 expref: 24 pid: 17109 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062096.987451:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130932736 00000100:00100000:0.0:1789062096.987454:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130932736 00010000:00010000:0.0:1789062096.987464:0:17101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c8198c00/0x2774d8f311dc7c2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7c27 expref: 25 pid: 17110 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062096.987474:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130932864 00000100:00100000:0.0:1789062096.987476:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130932864 00010000:00010000:0.0:1789062096.987486:0:17101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767fd47a600/0x2774d8f311dc7ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7ac2 expref: 26 pid: 17110 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062096.987498:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789062096.987505:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+26:3623:x1875967130932992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789062096.987517:0:17101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789062096.987522:0:17101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c1482200/0x2774d8f311dc7a7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7a75 expref: 26 pid: 17109 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.987531:0:17101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c1482200/0x2774d8f311dc7a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7a75 expref: 26 pid: 17109 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.987548:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c1482200/0x2774d8f311dc7a7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7a75 expref: 26 pid: 17109 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.987563:0:17101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789062096.987593:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+25:3623:x1875967130932992:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062096.987600:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789062096.987634:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789062096.987641:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+24:3620:x1875967130932736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789062096.987666:0:17101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789062096.987671:0:17101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766c8198c00/0x2774d8f311dc7c2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7c27 expref: 24 pid: 17110 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.987679:0:17101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c8198c00/0x2774d8f311dc7c2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7c27 expref: 24 pid: 17110 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.988001:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c8198c00/0x2774d8f311dc7c2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7c27 expref: 24 pid: 17110 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.988013:0:17101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789062096.988045:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+23:3620:x1875967130932736:12345-0@lo:103:ldlm_bl.0 Request processed in 404us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062096.988108:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789062096.988122:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789062096.988259:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+22:3620:x1875967130932864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789062096.988268:0:17101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789062096.988272:0:17101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767fd47a600/0x2774d8f311dc7ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7ac2 expref: 22 pid: 17110 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.988281:0:17101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767fd47a600/0x2774d8f311dc7ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7ac2 expref: 22 pid: 17110 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.988292:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767fd47a600/0x2774d8f311dc7ac9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7ac2 expref: 22 pid: 17110 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.988301:0:17101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789062096.988324:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:3620:x1875967130932864:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062096.988340:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789062096.988370:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8429180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83f5b9c6-643c-4659-afe5-bacf144ade05:3620:1875967130932864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789062096.988378:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:83f5b9c6-643c-4659-afe5-bacf144ade05:3620:1875967130932736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789062096.988469:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9766c807b200/0x2774d8f311dc7c27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7c2e expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062096.988487:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062096.988489:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062096.988491:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062096.989021:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062096.989046:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062096.989074:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120368640 00000100:00100000:3.0:1789062096.989080:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120368640 00010000:00010000:3.0:1789062096.989102:0:17102:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9767c0031800/0x2774d8f311dc7db6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcb7 expref: 13 pid: 17108 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062096.989120:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120368768 00000100:00100000:3.0:1789062096.989123:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120368768 00010000:00010000:3.0:1789062096.989145:0:17102:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c8198200/0x2774d8f311dc7d77 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc47 expref: 14 pid: 17108 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062096.989159:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1789062096.989165:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8094d664-afc8-4820-b5e6-f6352ebb9a04+14:2392:x1875967120368640:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789062096.989173:0:17102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789062096.989178:0:17102:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9767c0031800/0x2774d8f311dc7db6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcb7 expref: 14 pid: 17108 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.989188:0:17102:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9767c0031800/0x2774d8f311dc7db6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcb7 expref: 14 pid: 17108 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.989199:0:17102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062096.989235:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8094d664-afc8-4820-b5e6-f6352ebb9a04+14:2392:x1875967120368640:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 70us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062096.989242:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1789062096.989257:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:3.0:1789062096.989263:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7773850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:2392:x1875967120368768:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789062096.989277:0:17102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789062096.989281:0:17102:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766c8198200/0x2774d8f311dc7d77 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc47 expref: 13 pid: 17108 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.989290:0:17102:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c8198200/0x2774d8f311dc7d77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc47 expref: 13 pid: 17108 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.989299:0:17102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062096.989317:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7773850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:2392:x1875967120368768:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 54us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062096.989323:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:3.0:1789062096.989375:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:83f5b9c6-643c-4659-afe5-bacf144ade05:3623:1875967130932992:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789062096.989593:0:20139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031800/0x2774d8f311dc7db6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcb7 expref: 12 pid: 17108 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062096.989631:0:20139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1875967130931968:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789062096.989649:0:20139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c8198200/0x2774d8f311dc7d77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc47 expref: 11 pid: 17108 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062096.989658:0:20139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c676b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20139:1875967130932096:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789062096.989682:0:20139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062096.990079:0:20142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062096.990082:0:20142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062096.990084:0:20142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062096.990455:0:20141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2774d8f311dc7a8a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990464:0:20141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c1483200 already unused, calling callback (ffffffffc14eec20) 10000000:00010000:3.0:1789062096.990468:0:20141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2774d8f311dc7a8a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990477:0:20141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2774d8f311dc7a8a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789062096.990485:0:20141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2774d8f311dc7a8a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789062096.990490:0:20141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789062096.990529:0:20141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a8a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990546:0:20141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789062096.990585:0:20141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a8a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990592:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9767c1483200/0x2774d8f311dc7a83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2774d8f311dc7a8a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062096.990628:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789062096.990733:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130933120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789062096.990787:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062096.990832:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130933120 00000100:00100000:3.0:1789062096.990837:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130933120 00010000:00010000:3.0:1789062096.990857:0:17102:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766c807a600/0x2774d8f311dc7a8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7a83 expref: 21 pid: 17109 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062096.990881:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789062096.990888:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83f5b9c6-643c-4659-afe5-bacf144ade05+21:3622:x1875967130933120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789062096.990897:0:17102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789062096.990901:0:17102:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766c807a600/0x2774d8f311dc7a8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2774d8f311dc7a83 expref: 21 pid: 17109 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990910:0:17102:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766c807a600/0x2774d8f311dc7a8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2774d8f311dc7a83 expref: 21 pid: 17109 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990920:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766c807a600/0x2774d8f311dc7a8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2774d8f311dc7a83 expref: 21 pid: 17109 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990931:0:17102:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990944:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990958:0:17102:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990964:0:17102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990970:0:17102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990975:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990979:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031c00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:3.0:1789062096.990983:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.990990:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.991001:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062096.991009:0:17102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062096.991039:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:83f5b9c6-643c-4659-afe5-bacf144ade05+20:3622:x1875967130933120:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062096.991045:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789062096.991166:0:20139:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.991175:0:20139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062096.991181:0:20139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9767c0031c00/0x2774d8f311dc7de7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062096.992215:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130933120:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789062096.992242:0:20141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062096.992245:0:20141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789062096.992247:0:20141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789062097.077486:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130933248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789062097.077554:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062097.078667:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130933248 00000100:00100000:3.0:1789062097.078678:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130933248 00000100:00100000:3.0:1789062097.078743:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789062097.078764:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130933248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789062097.078793:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1789062097.080947:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789062097.087401:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd515500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130933248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8641us (9838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062097.087415:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789062097.097949:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130933248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789062097.580561:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789062097.580583:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c842b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130933504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789062097.580678:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062097.580786:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130933376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789062097.580786:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130933504 00000100:00100000:1.0:1789062097.580793:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130933504 00000100:00100000:2.0:1789062097.580809:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062097.580829:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130933376 00000100:00100000:1.0:1789062097.580832:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130933376 00000100:00100000:1.0:1789062097.580847:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789062097.580915:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130933504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789062097.580950:0:17121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789062097.580998:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130933504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062097.581152:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c842b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130933504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789062097.589818:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789062097.589838:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130933376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789062097.589876:0:17120:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789062097.589953:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130933376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (9143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062097.589961:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789062097.590038:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130933376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789062097.601628:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1789062097.974860:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062098.093859:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789062098.093881:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c859e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130933632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789062098.093948:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062098.094078:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130933632 00000100:00100000:3.0:1789062098.094087:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130933632 00000100:00100000:3.0:1789062098.094139:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789062098.094148:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130933632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789062098.094169:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789062098.094212:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130933632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062098.094219:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789062098.094259:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c859e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130933632:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789062098.094317:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789062098.668222:0:17867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789062098.698933:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062098.699010:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120368896 00000100:00100000:2.0:1789062098.699020:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120368896 00000100:00100000:2.0:1789062098.699074:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:2.0:1789062098.699084:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+11:14878:x1875967120368896:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789062098.699127:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062098.699149:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c5771000/0x2774d8f311dc7dee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bcef expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.699177:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c5771000/0x2774d8f311dc7dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcef expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.699189:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c5771000/0x2774d8f311dc7dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcef expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.699198:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5771000, rc 0) 00000100:00100000:2.0:1789062098.699254:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+12:14878:x1875967120368896:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 171us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062098.699261:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:2.0:1789062098.715801:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062098.717434:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120369024 00000100:00100000:0.0:1789062098.717448:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120369024 00000100:00100000:0.0:1789062098.717505:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:0.0:1789062098.717515:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+12:14878:x1875967120369024:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.717701:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+12:14878:x1875967120369024:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 186us (1905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062098.717709:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:3.0:1789062098.727290:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062098.727361:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120369152 00000100:00100000:1.0:1789062098.727369:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120369152 00000100:00100000:1.0:1789062098.727422:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:1.0:1789062098.727433:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+12:14878:x1875967120369152:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789062098.727582:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+12:14878:x1875967120369152:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 151us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062098.727590:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:3.0:1789062098.734685:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062098.734909:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120369280 00000100:00100000:0.0:1789062098.734920:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120369280 00000100:00100000:0.0:1789062098.734973:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:0.0:1789062098.734983:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+12:14878:x1875967120369280:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789062098.735001:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062098.735019:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0031000/0x2774d8f311dc7df5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bcf6 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.735047:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031000/0x2774d8f311dc7df5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcf6 expref: 13 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.735058:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0031000/0x2774d8f311dc7df5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcf6 expref: 13 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.735067:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031000, rc 0) 00000100:00100000:0.0:1789062098.735127:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:14878:x1875967120369280:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 145us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062098.735135:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:3.0:1789062098.738833:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062098.738899:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120369408 00000100:00100000:0.0:1789062098.738910:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120369408 00000100:00100000:0.0:1789062098.738969:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:0.0:1789062098.738978:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:14878:x1875967120369408:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.739112:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:14878:x1875967120369408:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 134us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062098.739128:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:3.0:1789062098.743043:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062098.743147:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120369536 00000100:00100000:1.0:1789062098.743156:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120369536 00000100:00100000:1.0:1789062098.743198:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:1.0:1789062098.743207:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:14878:x1875967120369536:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789062098.743332:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:14878:x1875967120369536:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 126us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062098.743340:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 152 10000000:01000000:3.0:1789062098.859596:0:17112:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789062098.859755:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767c74b8800 from 13 10000000:01000000:3.0:1789062098.859761:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789062098.859813:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80ce600/0x2774d8f311dc7dfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062098.859824:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c80ce600/0x2774d8f311dc7dfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062098.859836:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c80ce600/0x2774d8f311dc7dfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062098.859864:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c842b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130933760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789062098.859929:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062098.860089:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c5d45240 going to sleep for 11 seconds 00000100:00100000:0.0:1789062098.860905:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130933760 00000100:00100000:0.0:1789062098.860914:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130933760 00000100:00100000:0.0:1789062098.860977:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789062098.860987:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+20:17112:x1875967130933760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789062098.861000:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062098.861015:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc7e03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7dfc expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.861038:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc7e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7dfc expref: 21 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.861048:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767c0031e00/0x2774d8f311dc7e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7dfc expref: 21 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.861056:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031e00, rc 0) 00000100:00100000:0.0:1789062098.861103:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+21:17112:x1875967130933760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062098.861109:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789062098.861529:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c842b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130933760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789062098.861545:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c80ce600/0x2774d8f311dc7dfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7e03 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062098.861554:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c80ce600/0x2774d8f311dc7dfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7e03 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062098.861671:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c842b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130933888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789062098.861706:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062098.861734:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c5d45240 going to sleep for 11 seconds 00000100:00100000:3.0:1789062098.861759:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130933888 00000100:00100000:3.0:1789062098.861764:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130933888 00000100:00100000:3.0:1789062098.861795:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789062098.861804:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+21:17112:x1875967130933888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789062098.861920:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+21:17112:x1875967130933888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062098.861928:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789062098.862708:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c842b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130933888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.862759:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.862806:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062098.862837:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789062098.863814:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130934016 00000100:00100000:1.0:1789062098.863823:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130934016 00000100:00100000:1.0:1789062098.863870:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789062098.863878:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:17112:x1875967130934016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789062098.864240:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+21:17112:x1875967130934016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062098.864249:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789062098.864348:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789062098.867594:0:20218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789062098.867895:0:17112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789062098.867993:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789062098.868005:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c80ce600/0x2774d8f311dc7dfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7e03 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.868128:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c80ce600/0x2774d8f311dc7dfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7e03 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789062098.868139:0:17112:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789062098.868141:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fb31a800 from 13 10000000:01000000:0.0:1789062098.868144:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789062098.868178:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0030200/0x2774d8f311dc7e0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.868186:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c0030200/0x2774d8f311dc7e0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.868196:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c0030200/0x2774d8f311dc7e0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062098.868221:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.868282:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062098.868363:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0600 going to sleep for 11 seconds 00000100:00100000:2.0:1789062098.868460:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130934144 00000100:00100000:2.0:1789062098.868467:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130934144 00000100:00100000:2.0:1789062098.868543:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789062098.868552:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+21:17112:x1875967130934144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789062098.868564:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062098.868580:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c5770200/0x2774d8f311dc7e11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7e0a expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.868601:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c5770200/0x2774d8f311dc7e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7e0a expref: 22 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.869901:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c5770200/0x2774d8f311dc7e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7e0a expref: 22 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.869932:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5770200, rc 0) 00000100:00100000:2.0:1789062098.870121:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+22:17112:x1875967130934144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1569us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062098.870129:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789062098.870313:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789062098.870333:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c0030200/0x2774d8f311dc7e0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7e11 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.870350:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c0030200/0x2774d8f311dc7e0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7e11 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062098.870428:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.870458:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062098.871526:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0600 going to sleep for 11 seconds 00000100:00100000:2.0:1789062098.871648:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130934272 00000100:00100000:2.0:1789062098.871656:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130934272 00000100:00100000:2.0:1789062098.871706:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789062098.871714:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+22:17112:x1875967130934272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789062098.872072:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd817c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+22:17112:x1875967130934272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 353us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062098.872078:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789062098.872081:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789062098.872116:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.872167:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062098.872239:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130934400 00000100:00100000:1.0:1789062098.872244:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130934400 00000100:00100000:1.0:1789062098.872271:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789062098.872279:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+22:17112:x1875967130934400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.872345:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789062098.872355:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789062098.872356:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+22:17112:x1875967130934400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062098.872363:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000040:00080000:1.0:1789062098.876827:0:20219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789062098.877222:0:17112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789062098.877247:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789062098.877258:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0030200/0x2774d8f311dc7e0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7e11 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.877268:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c0030200/0x2774d8f311dc7e0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7e11 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789062098.877277:0:17112:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789062098.877279:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767fb2fe000 from 13 10000000:01000000:2.0:1789062098.877282:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789062098.877320:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c5770a00/0x2774d8f311dc7e18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.877327:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9766c5770a00/0x2774d8f311dc7e18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.877350:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9766c5770a00/0x2774d8f311dc7e18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062098.877375:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789062098.877438:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062098.877482:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1f97c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789062098.877590:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130934528 00000100:00100000:1.0:1789062098.877598:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130934528 00000100:00100000:1.0:1789062098.877666:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789062098.877675:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+22:17112:x1875967130934528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789062098.877687:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789062098.877699:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9767fd47be00/0x2774d8f311dc7e1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7e18 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062098.877721:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9767fd47be00/0x2774d8f311dc7e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7e18 expref: 23 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062098.877730:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9767fd47be00/0x2774d8f311dc7e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7e18 expref: 23 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062098.877748:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47be00, rc 0) 00000100:00100000:1.0:1789062098.877792:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+23:17112:x1875967130934528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062098.877799:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789062098.879420:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789062098.879444:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9766c5770a00/0x2774d8f311dc7e18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7e1f expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062098.879457:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9766c5770a00/0x2774d8f311dc7e18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7e1f expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062098.879569:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c842aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789062098.879823:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062098.879863:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c5d456c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789062098.879880:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130934656 00000100:00100000:0.0:1789062098.879887:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130934656 00000100:00100000:0.0:1789062098.879942:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789062098.879952:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+23:17112:x1875967130934656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.880089:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+23:17112:x1875967130934656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062098.880096:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789062098.880199:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c842aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789062098.880228:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c842aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789062098.880269:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062098.880299:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c5d456c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062098.880391:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130934784 00000100:00100000:1.0:1789062098.880396:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130934784 00000100:00100000:1.0:1789062098.880429:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789062098.880436:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+23:17112:x1875967130934784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789062098.880550:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+23:17112:x1875967130934784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062098.880557:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789062098.880773:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c842aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789062098.881922:0:20221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789062098.885233:0:17112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789062098.885385:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789062098.885396:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9766c5770a00/0x2774d8f311dc7e18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7e1f expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062098.885417:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9766c5770a00/0x2774d8f311dc7e18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7e1f expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789062098.887602:0:17112:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789062098.887727:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9767f7e7a800 from 13 10000000:01000000:0.0:1789062098.887733:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789062098.887788:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc7e26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.887860:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc7e26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.887873:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc7e26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062098.887901:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.887965:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062098.888016:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789062098.888106:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130934912 00000100:00100000:2.0:1789062098.888114:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130934912 00000100:00100000:2.0:1789062098.888167:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789062098.888176:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+23:17112:x1875967130934912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789062098.888190:0:17109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062098.888204:0:17109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766c5770400/0x2774d8f311dc7e2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2774d8f311dc7e26 expref: -99 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.888226:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766c5770400/0x2774d8f311dc7e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2774d8f311dc7e26 expref: 24 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.888238:0:17109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766c5770400/0x2774d8f311dc7e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2774d8f311dc7e26 expref: 24 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.888246:0:17109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5770400, rc 0) 00000100:00100000:2.0:1789062098.888296:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+24:17112:x1875967130934912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062098.888303:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789062098.888420:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130934912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789062098.888435:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc7e26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7e2d expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.888443:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc7e26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2774d8f311dc7e2d expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062098.888575:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130935040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.889579:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062098.889649:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789062098.889784:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130935040 00000100:00100000:2.0:1789062098.889791:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130935040 00000100:00100000:2.0:1789062098.889830:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789062098.889839:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:17112:x1875967130935040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789062098.893397:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:83f5b9c6-643c-4659-afe5-bacf144ade05+24:17112:x1875967130935040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3553us (4786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062098.893411:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789062098.894034:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130935040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.894086:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130935168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789062098.894136:0:17112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062098.894167:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062098.894683:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130935168 00000100:00100000:1.0:1789062098.894690:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130935168 00000100:00100000:1.0:1789062098.894731:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789062098.894749:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+24:17112:x1875967130935168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789062098.894848:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:83f5b9c6-643c-4659-afe5-bacf144ade05+24:17112:x1875967130935168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062098.894866:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789062098.901784:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:83f5b9c6-643c-4659-afe5-bacf144ade05:17112:1875967130935168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789062098.904754:0:20223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789062098.904950:0:17112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789062098.904984:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789062098.904995:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc7e26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7e2d expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062098.905007:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9767c0030400/0x2774d8f311dc7e26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2774d8f311dc7e2d expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062098.987624:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789062099.115599:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130935424:0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.115701:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062099.115734:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130935936:0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.115765:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062099.115781:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130936448:0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.115802:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062099.115824:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789062099.115829:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130935552:0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.116038:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062099.116058:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130936064:0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.116080:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062099.116095:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130936576:0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.116112:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062099.117343:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130936960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789062099.117388:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062099.119028:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130936960 00000100:00100000:1.0:1789062099.119040:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130936960 00000100:00100000:3.0:1789062099.119144:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130935296:0@lo:400:kworker.0 00000100:00100000:3.0:1789062099.119201:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062099.119230:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130935808:0@lo:400:kworker.0 00000100:00100000:3.0:1789062099.119250:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062099.122769:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130935424 00000100:00100000:2.0:1789062099.122782:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130935424 00000100:00100000:2.0:1789062099.122825:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130935936 00000100:00100000:2.0:1789062099.122828:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130935936 00000100:00100000:1.0:1789062099.122921:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789062099.122931:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130936960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789062099.122959:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789062099.123029:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130936960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (5640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062099.123035:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789062099.123308:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130936320:0@lo:400:kworker.0 00000100:00100000:3.0:1789062099.123342:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062099.123376:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130936832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789062099.123397:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062099.123415:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789062099.123421:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130935680:0@lo:400:kworker.0 00000100:00100000:3.0:1789062099.123436:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062099.123447:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875967130936192:0@lo:400:kworker.0 00000100:00100000:3.0:1789062099.123461:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062099.123468:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130936704:0@lo:400:kworker.0 00000100:00100000:3.0:1789062099.123486:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062099.123513:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130935552 00000100:00100000:3.0:1789062099.123517:0:19396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130935552 00000100:00100000:1.0:1789062099.123556:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130936448 00000100:00100000:1.0:1789062099.123560:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130936448 00000100:00100000:2.0:1789062099.124003:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130936064 00000100:00100000:2.0:1789062099.124007:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130936064 00000100:00100000:2.0:1789062099.124019:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789062099.124026:0:18619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767e68b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130935424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.124062:0:18619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767e68b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130935424:12345-0@lo:400:kworker.0 Request processed in 37us (8362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062099.124084:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789062099.124201:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789062099.124206:0:18619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130935936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.124229:0:18619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130935936:12345-0@lo:400:kworker.0 Request processed in 23us (8463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062099.124234:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789062099.124243:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789062099.124247:0:18619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130936064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.124266:0:18619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130936064:12345-0@lo:400:kworker.0 Request processed in 18us (8185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062099.124271:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789062099.124284:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130936576 00000100:00100000:2.0:1789062099.124287:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130936576 00000100:00100000:2.0:1789062099.124303:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130936320 00000100:00100000:2.0:1789062099.124305:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130936320 00000100:00100000:2.0:1789062099.124314:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130935680 00000100:00100000:2.0:1789062099.124316:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130935680 00000100:00100000:2.0:1789062099.124323:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130936192 00000100:00100000:2.0:1789062099.124325:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130936192 00000100:00100000:2.0:1789062099.124332:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130936704 00000100:00100000:2.0:1789062099.124334:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130936704 00000100:00100000:2.0:1789062099.124344:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789062099.124349:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130936576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.124373:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130936576:12345-0@lo:400:kworker.0 Request processed in 24us (8260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062099.124378:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789062099.124387:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789062099.124397:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130936320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.124424:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130936320:12345-0@lo:400:kworker.0 Request processed in 28us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062099.124430:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789062099.124439:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789062099.124443:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130935680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.124461:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875967130935680:12345-0@lo:400:kworker.0 Request processed in 18us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062099.124466:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789062099.124473:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789062099.124478:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875967130936192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.124494:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875967130936192:12345-0@lo:400:kworker.0 Request processed in 16us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062099.124779:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789062099.124794:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789062099.124801:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130936704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.124831:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130936704:12345-0@lo:400:kworker.0 Request processed in 31us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062099.124837:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789062099.124903:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875967130935680:0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.124924:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875967130936192:0@lo:400:kworker.0 00010000:00080000:2.0:1789062099.124937:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c4b65180 x1875967130936704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062099.124946:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130936704:0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.124966:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130936320:0@lo:400:kworker.0 00000100:00100000:3.0:1789062099.125301:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789062099.125308:0:19396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130935552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062099.125342:0:19396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130935552:12345-0@lo:400:kworker.0 Request processed in 34us (9304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062099.125347:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789062099.125371:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130935296 00000100:00100000:3.0:1789062099.125375:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130935296 00000100:00100000:3.0:1789062099.125401:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130935808 00000100:00100000:3.0:1789062099.125403:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130935808 00000100:00100000:3.0:1789062099.125416:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789062099.125421:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130935296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062099.125455:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130935296:12345-0@lo:400:kworker.0 Request processed in 33us (6253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062099.125461:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789062099.125472:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789062099.125480:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130935808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062099.125530:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130935808:12345-0@lo:400:kworker.0 Request processed in 52us (6279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062099.125535:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789062099.126867:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130936832 00000100:00100000:3.0:1789062099.126876:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130936832 00000100:00100000:3.0:1789062099.126910:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789062099.126918:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130936832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789062099.126937:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789062099.126991:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130936832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (3590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062099.126996:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789062099.129279:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130935296:0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.129296:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130935808:0@lo:400:kworker.0 00000100:00100000:2.0:1789062099.129318:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c859d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130936832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789062099.130078:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789062099.130090:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130936448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062099.130178:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130936448:12345-0@lo:400:kworker.0 Request processed in 91us (14374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062099.130185:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789062099.130395:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789062099.130401:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789062099.130404:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789062099.130407:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789062099.130444:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130936960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789062099.130458:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130935552:0@lo:400:kworker.0 00000100:00100000:0.0:1789062099.130467:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130936064:0@lo:400:kworker.0 00000100:00100000:0.0:1789062099.131205:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130936576:0@lo:400:kworker.0 00000100:00100000:0.0:1789062099.131219:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd515880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130935424:0@lo:400:kworker.0 00000100:00100000:0.0:1789062099.131230:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c8171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130935936:0@lo:400:kworker.0 00010000:00080000:0.0:1789062099.131242:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9767c4b65f80 x1875967130936448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789062099.131252:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130936448:0@lo:400:kworker.0 00010000:00010000:2.0:1789062100.009826:0:20142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062100.229878:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062100.229922:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062100.229977:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062100.230007:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062100.230029:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062100.230045:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062100.230061:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062100.230077:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062100.230096:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062100.230227:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120369792 00000100:00100000:1.0:1789062100.230236:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120369792 00000100:00100000:1.0:1789062100.230290:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120370304 00000100:00100000:1.0:1789062100.230293:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120370304 00000100:00100000:1.0:1789062100.230306:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120369920 00000100:00100000:1.0:1789062100.230307:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120369920 00000100:00100000:1.0:1789062100.230319:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120370432 00000100:00100000:1.0:1789062100.230321:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120370432 00000100:00100000:1.0:1789062100.230336:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:1.0:1789062100.230344:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2391:x1875967120369792:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789062100.230414:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2391:x1875967120369792:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 70us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062100.230421:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:1.0:1789062100.230438:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:1.0:1789062100.230445:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:2391:x1875967120370304:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789062100.230468:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:2391:x1875967120370304:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 24us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062100.230474:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:1.0:1789062100.230485:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:1.0:1789062100.230490:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2391:x1875967120369920:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789062100.230512:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2391:x1875967120369920:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062100.230518:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:1.0:1789062100.230528:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:1.0:1789062100.230534:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2391:x1875967120370432:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789062100.230553:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2391:x1875967120370432:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 19us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062100.230566:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1789062100.230655:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120370048 00000100:00100000:2.0:1789062100.230660:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120370048 00000100:00100000:2.0:1789062100.230694:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120370560 00000100:00100000:2.0:1789062100.230697:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120370560 00000100:00100000:2.0:1789062100.230711:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120370176 00000100:00100000:2.0:1789062100.230713:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120370176 00000100:00100000:2.0:1789062100.230723:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120370688 00000100:00100000:2.0:1789062100.230738:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120370688 00000100:00100000:2.0:1789062100.230754:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1789062100.230760:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2391:x1875967120370048:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789062100.230787:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2391:x1875967120370048:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062100.230793:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1789062100.230805:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1789062100.230811:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2391:x1875967120370560:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789062100.230832:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2391:x1875967120370560:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062100.230838:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1789062100.230848:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1789062100.230854:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2391:x1875967120370176:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789062100.230885:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2391:x1875967120370176:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 31us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062100.230891:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1789062100.230903:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1789062100.230909:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2391:x1875967120370688:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789062100.230929:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2391:x1875967120370688:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 20us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062100.230934:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1789062100.230955:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120369664 00000100:00100000:2.0:1789062100.230958:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120369664 00000100:00100000:2.0:1789062100.230993:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 165 00000100:00100000:2.0:1789062100.230999:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:2391:x1875967120369664:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789062100.231020:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd818850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:2391:x1875967120369664:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062100.231026:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 165 00000100:00080000:0.0:1789062100.232071:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789062100.232077:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789062100.232081:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789062100.232083:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789062100.785049:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062100.785200:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120370816 00000100:00100000:1.0:1789062100.785210:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120370816 00000100:00100000:1.0:1789062100.785326:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:1.0:1789062100.785337:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+6:15546:x1875967120370816:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789062100.785364:0:19906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789062100.785387:0:19906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bcfd expref: -99 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785451:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7e3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785466:0:19906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785479:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785492:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7e42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785498:0:19906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785505:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785576:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc7e49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785596:0:19906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc7e49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785601:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc7e49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789062100.785662:0:19906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789062100.785665:0:19906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789062100.785691:0:19906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc7e49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785699:0:19906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785704:0:19906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7e3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785708:0:19906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7e3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785712:0:19906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789062100.785714:0:19906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7e3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785719:0:19906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7e3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785737:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d6acc400) 00010000:00010000:1.0:1789062100.785740:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789062100.785745:0:19906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7e3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785765:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7e3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785778:0:19906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785785:0:19906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7e42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785792:0:19906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785797:0:19906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789062100.785800:0:19906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785805:0:19906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7e42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785812:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9766c15be400) 00010000:00010000:1.0:1789062100.785815:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789062100.785817:0:19906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7e42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785822:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7e42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785854:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcfd expref: 8 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785878:0:19906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a800/0x2774d8f311dc7e49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bcfd expref: 7 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.785884:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9766c15beb00) 00010000:00010000:1.0:1789062100.785886:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789062100.785888:0:19906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47a800, rc 0) 00000100:00100000:1.0:1789062100.785949:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+7:15546:x1875967120370816:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 615us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062100.785957:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:3.0:1789062100.800479:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062100.805240:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120370944 00000100:00100000:2.0:1789062100.805254:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120370944 00000100:00100000:2.0:1789062100.805539:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:2.0:1789062100.805552:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1b10d670-7f0f-4a11-9d02-f894398913c8+7:15546:x1875967120370944:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789062100.805654:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1b10d670-7f0f-4a11-9d02-f894398913c8+7:15546:x1875967120370944:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 Request processed in 105us (5184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062100.805662:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:0.0:1789062100.808878:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062100.808954:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120371200 00000100:00100000:1.0:1789062100.808964:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120371200 00000100:00100000:1.0:1789062100.809031:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:1.0:1789062100.809042:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+7:15546:x1875967120371200:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789062100.809065:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789062100.809086:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc7e50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd04 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809163:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a600/0x2774d8f311dc7e57 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809177:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a600/0x2774d8f311dc7e57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809189:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a600/0x2774d8f311dc7e57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809229:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809249:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809257:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809354:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47bc00/0x2774d8f311dc7e65 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809362:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47bc00/0x2774d8f311dc7e65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809369:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47bc00/0x2774d8f311dc7e65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789062100.809379:0:17116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789062100.809529:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a600/0x2774d8f311dc7e57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809536:0:17116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a600/0x2774d8f311dc7e57 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809542:0:17116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a600/0x2774d8f311dc7e57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809548:0:17116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789062100.809552:0:17116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a600/0x2774d8f311dc7e57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809560:0:17116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a600/0x2774d8f311dc7e57 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809582:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9766c15beb00) 00010000:00010000:1.0:1789062100.809585:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789062100.809590:0:17116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a600/0x2774d8f311dc7e57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809597:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a600/0x2774d8f311dc7e57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809652:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809659:0:17116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e5e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809665:0:17116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809670:0:17116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ae00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789062100.809673:0:17116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809680:0:17116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e5e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809687:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9766c15be200) 00010000:00010000:1.0:1789062100.809689:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789062100.809692:0:17116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e5e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.809697:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e5e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.810942:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc7e50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd04 expref: 10 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.810965:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47bc00/0x2774d8f311dc7e65 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd04 expref: 9 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.810973:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c15be500) 00010000:00010000:1.0:1789062100.810975:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789062100.810978:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47bc00, rc 0) 00000100:00100000:1.0:1789062100.811201:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+9:15546:x1875967120371200:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 2160us (2331us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789062100.811210:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:3.0:1789062100.828525:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062100.828660:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120371328 00000100:00100000:2.0:1789062100.828670:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120371328 00000100:00100000:2.0:1789062100.828753:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1789062100.828763:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+9:15546:x1875967120371328:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789062100.828868:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+9:15546:x1875967120371328:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 107us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062100.828876:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:3.0:1789062100.837116:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062100.837443:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120371456 00000100:00100000:0.0:1789062100.837453:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120371456 00000100:00100000:0.0:1789062100.837515:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:0.0:1789062100.837525:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+5:15546:x1875967120371456:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1789062100.839990:0:17117:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2423us 00000100:00100000:3.0:1789062100.855894:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+5:15546:x1875967120371456:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 18361us (18789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062100.855906:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:0.0:1789062100.907225:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062100.907334:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120371584 00000100:00100000:2.0:1789062100.907344:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120371584 00000100:00100000:2.0:1789062100.907405:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:2.0:1789062100.907415:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+9:15552:x1875967120371584:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789062100.907435:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062100.907456:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd0b expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907518:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7e7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907533:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7e7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907547:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7e7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907560:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907567:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907574:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907665:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7e7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907673:0:17115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7e7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907681:0:17115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7e7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907687:0:17115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5771e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789062100.907691:0:17115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7e7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907700:0:17115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7e7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907711:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d6acc400) 00010000:00010000:2.0:1789062100.907715:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789062100.907719:0:17115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907741:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907754:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907761:0:17115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907768:0:17115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907780:0:17115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5770c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789062100.907783:0:17115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907790:0:17115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907798:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9767d1235e00) 00010000:00010000:2.0:1789062100.907800:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789062100.907804:0:17115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907810:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907839:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e73 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd0b expref: 10 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907849:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d6acc400) 00010000:00010000:2.0:1789062100.907851:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789062100.907855:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd0b expref: 10 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.907864:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5770800, rc 0) 00000100:00100000:2.0:1789062100.907931:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+9:15552:x1875967120371584:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 516us (715us total) trans 0 rc 301/301 00000100:00100000:2.0:1789062100.907938:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1789062100.914304:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062100.914396:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120371712 00000100:00100000:3.0:1789062100.914405:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120371712 00000100:00100000:3.0:1789062100.914450:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1789062100.914459:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1b10d670-7f0f-4a11-9d02-f894398913c8+9:15552:x1875967120371712:12345-192.168.203.3@tcp:700:lfs.0 00000100:00100000:3.0:1789062100.914534:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1b10d670-7f0f-4a11-9d02-f894398913c8+9:15552:x1875967120371712:12345-192.168.203.3@tcp:700:lfs.0 Request processed in 76us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062100.914541:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1789062100.917286:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062100.917454:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120371968 00000100:00100000:1.0:1789062100.917464:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120371968 00000100:00100000:1.0:1789062100.917522:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:1.0:1789062100.917532:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+9:15552:x1875967120371968:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:1.0:1789062100.917587:0:17116:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789062100.917653:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c8199800/0x2774d8f311dc7da1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bc78 expref: 9 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.917673:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d6acc400) 00010000:00010000:1.0:1789062100.917678:0:17116:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789062100.917912:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.917927:0:17116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7de0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bce8 expref: 5 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.917943:0:17116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.917974:0:17116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bce8 expref: 5 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062100.917989:0:17116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7de0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bce8 expref: 5 pid: 17117 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062100.918004:0:17116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767fd5fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17116:1875967130937088:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789062100.918087:0:17116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fb0e6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789062100.928206:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062100.928332:0:17116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767fd5fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17116:1875967130937088:192.168.203.3@tcp:104: 00010000:00010000:1.0:1789062100.928358:0:17116:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062100.928410:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120372096 00000100:00100000:3.0:1789062100.928418:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120372096 00010000:00010000:3.0:1789062100.928453:0:17101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7de0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bce8 expref: 6 pid: 17117 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062100.928496:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:3.0:1789062100.928505:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:2392:x1875967120372096:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789062100.928519:0:17101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789062100.928527:0:17101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7de0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bce8 expref: 6 pid: 17117 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062100.928540:0:17101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bce8 expref: 6 pid: 17117 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062100.928564:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7de0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bce8 expref: 6 pid: 17117 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062100.928580:0:17101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d6acc400) 00010000:00010000:3.0:1789062100.928585:0:17101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062100.928593:0:17101:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062100.928601:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062100.928683:0:17101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062100.928745:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2392:x1875967120372096:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 240us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062100.928766:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00010000:00010000:2.0:1789062100.928914:0:17116:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.928930:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.928952:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e8f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.928962:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.928980:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930602:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930654:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930664:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789062100.930680:0:17116:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b24076ac reply state 0000000086cdda29 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930691:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930698:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9767d1235500) 00010000:00010000:2.0:1789062100.930700:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789062100.930704:0:17116:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789062100.930709:0:17116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789062100.930743:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930749:0:17116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930756:0:17116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930762:0:17116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ae00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789062100.930767:0:17116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930773:0:17116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930784:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d6acc400) 00010000:00010000:2.0:1789062100.930786:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789062100.930790:0:17116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930795:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ae00/0x2774d8f311dc7e88 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789062100.930812:0:17116:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b24076ac reply state 0000000086cdda29 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930819:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062100.930825:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9767d1235e00) 00010000:00010000:2.0:1789062100.930827:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789062100.930835:0:17116:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789062100.930915:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+10:15552:x1875967120371968:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 13382us (13638us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789062100.930925:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00010000:00010000:3.0:1789062101.034069:0:20141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062101.043373:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.043449:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120372224 00000100:00100000:2.0:1789062101.043459:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120372224 00000100:00100000:2.0:1789062101.043524:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:2.0:1789062101.043534:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+10:15560:x1875967120372224:12345-192.168.203.3@tcp:101:lctl.0 00010000:00010000:2.0:1789062101.043557:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062101.043580:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7e9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd12 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.043696:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770e00/0x2774d8f311dc7ea4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.043711:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770e00/0x2774d8f311dc7ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.043862:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770e00/0x2774d8f311dc7ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789062101.043906:0:17115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789062101.043910:0:17115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789062101.043945:0:17115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770e00/0x2774d8f311dc7ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.043969:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7e9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd12 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.043987:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770e00/0x2774d8f311dc7ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd12 expref: 11 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.044014:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d1235d00) 00010000:00010000:2.0:1789062101.044017:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789062101.044021:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5770e00, rc 0) 00000100:00100000:2.0:1789062101.044140:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+11:15560:x1875967120372224:12345-192.168.203.3@tcp:101:lctl.0 Request processed in 607us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062101.044147:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:3.0:1789062101.066462:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062101.066595:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120372352 00000100:00100000:0.0:1789062101.066636:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120372352 00000100:00100000:0.0:1789062101.066689:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:0.0:1789062101.066698:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c842b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:15561:x1875967120372352:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789062101.066733:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062101.066751:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc7eab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd19 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.066825:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc7eb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.066838:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc7eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.066848:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc7eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789062101.066883:0:17117:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789062101.066886:0:17117:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789062101.066904:0:17117:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc7eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.066925:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc7eab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd19 expref: 7 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.066941:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030e00/0x2774d8f311dc7eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd19 expref: 6 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.066949:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d1235d00) 00010000:00010000:0.0:1789062101.066952:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789062101.066955:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0030e00, rc 0) 00000100:00100000:0.0:1789062101.067005:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c842b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:15561:x1875967120372352:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 308us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062101.067012:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1789062101.070675:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062101.070846:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120372480 00000100:00100000:1.0:1789062101.070855:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120372480 00000100:00100000:1.0:1789062101.070907:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:1.0:1789062101.070915:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:15561:x1875967120372480:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1789062101.070934:0:19906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789062101.070953:0:19906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a600/0x2774d8f311dc7eb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd20 expref: -99 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071013:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7ec0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071026:0:19906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071051:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071064:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7ec7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071072:0:19906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071079:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071164:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7ece lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071173:0:19906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7ece lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071181:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7ece lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789062101.071215:0:19906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789062101.071218:0:19906:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789062101.071237:0:19906:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7ece lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071248:0:19906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071254:0:19906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7ec0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071271:0:19906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071277:0:19906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47ba00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789062101.071281:0:19906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071493:0:19906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7ec0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071509:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d1235d00) 00010000:00010000:1.0:1789062101.071513:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789062101.071518:0:19906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7ec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071526:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47ba00/0x2774d8f311dc7ec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071540:0:19906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071547:0:19906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7ec7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071553:0:19906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071559:0:19906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789062101.071563:0:19906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071579:0:19906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7ec7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071588:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9767d1235e00) 00010000:00010000:1.0:1789062101.071591:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789062101.071594:0:19906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7ec7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071599:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b800/0x2774d8f311dc7ec7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071701:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a600/0x2774d8f311dc7eb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd20 expref: 8 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071793:0:19906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7ece lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd20 expref: 7 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062101.071801:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9767d1235500) 00010000:00010000:1.0:1789062101.071804:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789062101.071807:0:19906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767fd47b200, rc 0) 00000100:00100000:1.0:1789062101.071914:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+7:15561:x1875967120372480:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 999us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062101.071923:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:3.0:1789062101.075068:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.075202:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120372608 00000100:00100000:2.0:1789062101.075211:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120372608 00000100:00100000:2.0:1789062101.075264:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1789062101.075273:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:15561:x1875967120372608:12345-192.168.203.3@tcp:900:lfs.0 00000100:00100000:2.0:1789062101.075342:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:15561:x1875967120372608:12345-192.168.203.3@tcp:900:lfs.0 Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062101.075350:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1789062101.078989:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062101.079088:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120372864 00000100:00100000:0.0:1789062101.079097:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120372864 00000100:00100000:0.0:1789062101.079169:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:0.0:1789062101.079177:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+7:15561:x1875967120372864:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789062101.079194:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062101.079212:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc7ed5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd27 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789062101.079304:0:17117:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789062101.079398:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc7ed5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd27 expref: 9 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.079411:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d1235d00) 00010000:00010000:0.0:1789062101.079414:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789062101.079418:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc7ed5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd27 expref: 9 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.079429:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031400, rc 0) 00000100:00100000:0.0:1789062101.079485:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+8:15561:x1875967120372864:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 309us (505us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789062101.079492:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:3.0:1789062101.087761:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.087898:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120373120 00000100:00100000:2.0:1789062101.087908:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120373120 00000100:00100000:2.0:1789062101.087965:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:2.0:1789062101.087974:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+8:15561:x1875967120373120:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:2.0:1789062101.088024:0:17115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789062101.088047:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b200/0x2774d8f311dc7ece lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd20 expref: 8 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.088065:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9767d1235500) 00010000:00010000:2.0:1789062101.088069:0:17115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789062101.088088:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7ee3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.088125:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.088134:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789062101.088321:0:17115:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005e2c338 reply state 0000000001072214 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.088332:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7ee3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.088343:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9767d1235500) 00010000:00010000:2.0:1789062101.088346:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789062101.088349:0:17115:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789062101.088356:0:17115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789062101.088429:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+9:15561:x1875967120373120:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 455us (677us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789062101.088436:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:3.0:1789062101.097343:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062101.097477:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120373376 00000100:00100000:1.0:1789062101.097488:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120373376 00000100:00100000:1.0:1789062101.097546:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:1.0:1789062101.097556:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+9:15561:x1875967120373376:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:1.0:1789062101.097950:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+10:15561:x1875967120373376:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 394us (614us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789062101.097959:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:3.0:1789062101.101566:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062101.101662:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120373632 00000100:00100000:0.0:1789062101.101671:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120373632 00000100:00100000:0.0:1789062101.101740:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:0.0:1789062101.101749:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+10:15561:x1875967120373632:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:0.0:1789062101.101771:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062101.101790:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc7eea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd2e expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.101873:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc7ef1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.101886:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc7ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.101897:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc7ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.101906:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc7ef8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.101914:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc7ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.101919:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc7ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789062101.102017:0:17117:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789062101.102080:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc7ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102088:0:17117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc7ef1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102094:0:17117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc7ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102113:0:17117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789062101.102117:0:17117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc7ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102135:0:17117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc7ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102146:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d1235d00) 00010000:00010000:0.0:1789062101.102149:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789062101.102153:0:17117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc7ef1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102159:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030600/0x2774d8f311dc7ef1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102170:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc7ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102175:0:17117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc7ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102180:0:17117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc7ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102184:0:17117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0030c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1789062101.102186:0:17117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc7ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102191:0:17117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc7ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102196:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9767d1235e00) 00010000:00010000:0.0:1789062101.102198:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789062101.102201:0:17117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc7ef8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102214:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0030c00/0x2774d8f311dc7ef8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102244:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc7eea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd2e expref: 12 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102253:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d1235d00) 00010000:00010000:0.0:1789062101.102255:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789062101.102258:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031400/0x2774d8f311dc7eea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd2e expref: 12 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062101.102267:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031400, rc 0) 00000100:00100000:0.0:1789062101.102326:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+11:15561:x1875967120373632:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 577us (769us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1789062101.102333:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:3.0:1789062101.106562:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.106756:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120373760 00000100:00100000:2.0:1789062101.106767:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120373760 00000100:00100000:2.0:1789062101.106824:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:2.0:1789062101.106835:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+11:15561:x1875967120373760:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789062101.106859:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062101.106880:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f06 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd35 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.106976:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.107007:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.107020:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789062101.107050:0:17115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789062101.107054:0:17115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789062101.107072:0:17115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.107097:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f06 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd35 expref: 13 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.107128:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd35 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.107136:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9767d1235500) 00010000:00010000:2.0:1789062101.107139:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789062101.107142:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5771400, rc 0) 00000100:00100000:2.0:1789062101.107200:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+12:15561:x1875967120373760:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 366us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062101.107207:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:3.0:1789062101.112561:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062101.112705:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120373888 00000100:00100000:1.0:1789062101.112732:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120373888 00000100:00100000:1.0:1789062101.112787:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:1.0:1789062101.112797:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+12:15561:x1875967120373888:12345-192.168.203.3@tcp:37:lfs.0 00000100:00100000:1.0:1789062101.117599:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+12:15561:x1875967120373888:12345-192.168.203.3@tcp:37:lfs.0 Request processed in 4794us (5035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062101.117644:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:3.0:1789062101.121728:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.122025:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120374144 00000100:00100000:2.0:1789062101.122034:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120374144 00000100:00100000:2.0:1789062101.122120:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:2.0:1789062101.122131:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7e61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+12:15561:x1875967120374144:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1789062101.122374:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7e61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+13:15561:x1875967120374144:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 244us (671us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789062101.122395:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1789062101.189316:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062101.189477:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120374272 00000100:00100000:3.0:1789062101.189487:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120374272 00000100:00100000:3.0:1789062101.189550:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:3.0:1789062101.189561:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+11:15567:x1875967120374272:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1789062101.189580:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062101.189601:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7f14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd3c expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189705:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7f1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189732:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189745:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189775:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189783:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189789:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189867:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7f29 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189875:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7f29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189882:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7f29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789062101.189915:0:17117:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789062101.189919:0:17117:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789062101.189954:0:17117:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7f29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189966:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7f1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189973:0:17117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7f1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189979:0:17117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7f1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.189995:0:17117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cf600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789062101.190000:0:17117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7f1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190008:0:17117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7f1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190020:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d1235d00) 00010000:00010000:3.0:1789062101.190023:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789062101.190028:0:17117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7f1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190034:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7f1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190048:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190054:0:17117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190060:0:17117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190065:0:17117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80cec00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789062101.190067:0:17117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190072:0:17117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190089:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9767d1235e00) 00010000:00010000:3.0:1789062101.190092:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789062101.190095:0:17117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190112:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190139:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7f14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd3c expref: 13 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190153:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf200/0x2774d8f311dc7f29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd3c expref: 12 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.190160:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9767d1235500) 00010000:00010000:3.0:1789062101.190162:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789062101.190165:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cf200, rc 0) 00000100:00100000:3.0:1789062101.190225:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+12:15567:x1875967120374272:12345-192.168.203.3@tcp:101:bash.0 Request processed in 666us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062101.190232:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:0.0:1789062101.193250:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.193446:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120374400 00000100:00100000:2.0:1789062101.193456:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120374400 00000100:00100000:2.0:1789062101.193511:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1789062101.193521:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1b10d670-7f0f-4a11-9d02-f894398913c8+5:15567:x1875967120374400:12345-192.168.203.3@tcp:900:bash.0 00000100:00100000:2.0:1789062101.193601:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1b10d670-7f0f-4a11-9d02-f894398913c8+5:15567:x1875967120374400:12345-192.168.203.3@tcp:900:bash.0 Request processed in 81us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062101.193651:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1789062101.203195:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.203332:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120374656 00000100:00100000:2.0:1789062101.203342:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120374656 00000100:00100000:2.0:1789062101.203398:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:2.0:1789062101.203408:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+12:15567:x1875967120374656:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1789062101.203429:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062101.203449:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f30 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd43 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.203562:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.203578:0:17115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd35 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.203588:0:17115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.203675:0:17115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd35 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.203712:0:17115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd35 expref: 12 pid: 17115 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062101.203737:0:17115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b64700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17115:1875967130937216:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789062101.203937:0:17115:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fd481d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789062101.217092:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062101.217226:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120374784 00000100:00100000:3.0:1789062101.217235:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120374784 00010000:00010000:3.0:1789062101.217275:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f0d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd35 expref: 13 pid: 17115 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062101.217315:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1789062101.217324:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c859c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+13:2393:x1875967120374784:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789062101.217351:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789062101.217358:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f0d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd35 expref: 13 pid: 17115 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.217370:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd35 expref: 13 pid: 17115 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.217390:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9767d1235500) 00010000:00010000:3.0:1789062101.217395:0:17100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.217405:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.217421:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.217442:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062101.217500:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+13:2393:x1875967120374784:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 177us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062101.217507:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00010000:00010000:2.0:1789062101.218235:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd35 expref: 12 pid: 17115 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062101.218253:0:17115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b64700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17115:1875967130937216:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789062101.218273:0:17115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.218281:0:17115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.218287:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.218311:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc7f3e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.218321:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc7f3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.218329:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc7f3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219021:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc7f45 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219045:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc7f45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219054:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc7f45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789062101.219066:0:17115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789062101.219095:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219174:0:17115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219181:0:17115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219188:0:17115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5771a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789062101.219192:0:17115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219200:0:17115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219211:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9767d1235500) 00010000:00010000:2.0:1789062101.219214:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789062101.219218:0:17115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219224:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f37 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789062101.219235:0:17115:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad0ca6f1 reply state 000000006d3bcc4a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc7f3e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219253:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc7f3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219260:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9767d1235400) 00010000:00010000:2.0:1789062101.219262:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789062101.219264:0:17115:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789062101.219315:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f30 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd43 expref: 15 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219330:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc7f45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd43 expref: 14 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.219339:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062101.219341:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789062101.219342:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5771200, rc 0) 00000100:00100000:2.0:1789062101.219390:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c859fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+15:15567:x1875967120374656:12345-192.168.203.3@tcp:101:bash.0 Request processed in 15983us (16203us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789062101.219397:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:0.0:1789062101.247513:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062101.250494:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120374912 00000100:00100000:3.0:1789062101.250509:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120374912 00000100:00100000:3.0:1789062101.250586:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:3.0:1789062101.250596:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+15:15567:x1875967120374912:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1789062101.250670:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062101.250690:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7f53 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd4a expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.251025:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.251039:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.251051:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789062101.251167:0:17117:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789062101.251172:0:17117:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789062101.251194:0:17117:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.251269:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.251307:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7f53 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd4a expref: 17 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.251327:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd4a expref: 16 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.251336:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:3.0:1789062101.251339:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789062101.251343:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cec00, rc 0) 00000100:00100000:3.0:1789062101.251458:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+16:15567:x1875967120374912:12345-192.168.203.3@tcp:101:bash.0 Request processed in 863us (3955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062101.251467:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:0.0:1789062101.263597:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062101.264282:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120375168 00000100:00100000:1.0:1789062101.264353:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120375168 00000100:00100000:1.0:1789062101.264446:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:1.0:1789062101.264457:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+16:15567:x1875967120375168:12345-192.168.203.3@tcp:35:bash.0 00000001:00080000:1.0:1789062101.264691:0:17118:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:1.0:1789062101.264828:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+18:15567:x1875967120375168:12345-192.168.203.3@tcp:35:bash.0 Request processed in 371us (1237us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1789062101.264836:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000020:00080000:1.0:1789062101.264840:0:17118:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789062101.397064:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062101.397195:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120375424 00000100:00100000:3.0:1789062101.397211:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120375424 00000100:00100000:3.0:1789062101.397274:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:3.0:1789062101.397283:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+18:15578:x1875967120375424:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:3.0:1789062101.397308:0:19906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062101.397326:0:19906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7f61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd51 expref: -99 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789062101.397421:0:19906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789062101.397518:0:19906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7f61 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd51 expref: 20 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.397532:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9767d1235d00) 00010000:00010000:3.0:1789062101.397535:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789062101.397541:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7f61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd51 expref: 20 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.397557:0:19906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80ce200, rc 0) 00000100:00100000:3.0:1789062101.397798:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+19:15578:x1875967120375424:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 515us (741us total) trans 8589934603 rc 301/301 00000100:00100000:3.0:1789062101.397807:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:0.0:1789062101.416289:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.416447:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120375680 00000100:00100000:2.0:1789062101.416460:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120375680 00000100:00100000:2.0:1789062101.416523:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1789062101.416534:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+19:15578:x1875967120375680:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1789062101.416810:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+20:15578:x1875967120375680:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 277us (530us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789062101.416818:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000040:00080000:2.0:1789062101.483169:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789062101.527322:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.528394:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120375936 00000100:00100000:2.0:1789062101.528406:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120375936 00000100:00100000:2.0:1789062101.528471:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:2.0:1789062101.528481:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+20:15581:x1875967120375936:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1789062101.528506:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062101.528526:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f6f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd58 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.528662:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f76 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.528676:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.528687:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789062101.528699:0:17116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789062101.528815:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f6f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd58 expref: 23 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.528833:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd58 expref: 22 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.528842:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062101.528845:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789062101.528848:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5771a00, rc 0) 00000100:00100000:2.0:1789062101.528899:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+22:15581:x1875967120375936:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 420us (1586us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789062101.528933:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:0.0:1789062101.548477:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.548572:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120376064 00000100:00100000:2.0:1789062101.548583:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120376064 00000100:00100000:2.0:1789062101.548684:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:2.0:1789062101.548695:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c676a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+22:15581:x1875967120376064:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:2.0:1789062101.548769:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.548786:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.548798:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.548832:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.548840:0:17115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.548847:0:17115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.548853:0:17115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5770600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789062101.548858:0:17115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.548865:0:17115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f84 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.548875:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062101.548889:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789062101.548894:0:17115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f84 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.548900:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062101.549578:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062101.549682:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120376192 00000100:00100000:3.0:1789062101.549688:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120376192 00000100:00100000:3.0:1789062101.549746:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1789062101.549754:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+23:2391:x1875967120376192:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789062101.549765:0:17102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789062101.549781:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7f76 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd58 expref: 23 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.549803:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:3.0:1789062101.549807:0:17102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062101.549866:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+22:2391:x1875967120376192:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 112us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062101.549873:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1789062101.550857:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c676a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+21:15581:x1875967120376064:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 2160us (2389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062101.550866:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:0.0:1789062101.559385:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.559466:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120376448 00000100:00100000:2.0:1789062101.559476:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120376448 00000100:00100000:2.0:1789062101.559535:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1789062101.559569:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+21:15581:x1875967120376448:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1789062101.559831:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+22:15581:x1875967120376448:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 264us (455us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789062101.559839:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000040:00080000:1.0:1789062101.740634:0:17867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789062101.984164:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.984412:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120376704 00000100:00100000:2.0:1789062101.984422:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120376704 00000100:00100000:2.0:1789062101.984489:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:2.0:1789062101.984499:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767df7da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+22:15612:x1875967120376704:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:2.0:1789062101.984522:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062101.984541:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f8b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd5f expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.984684:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.984698:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.984712:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789062101.984741:0:17116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789062101.984853:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc7f8b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd5f expref: 25 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.984870:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd5f expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062101.984878:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062101.984881:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789062101.984885:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5771400, rc 0) 00000100:00100000:2.0:1789062101.984940:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767df7da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+24:15612:x1875967120376704:12345-192.168.203.3@tcp:101:cat.0 Request processed in 442us (785us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789062101.984947:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:0.0:1789062101.992198:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062101.992374:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120376832 00000100:00100000:3.0:1789062101.992382:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120376832 00000100:00100000:3.0:1789062101.992451:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:3.0:1789062101.992461:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767df7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+24:2393:x1875967120376832:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789062101.992476:0:17101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789062101.992499:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7f92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd5f expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062101.992518:0:17101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:3.0:1789062101.992523:0:17101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062101.992581:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767df7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+23:2393:x1875967120376832:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 121us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062101.992588:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:1.0:1789062101.997382:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062101.997470:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120377088 00000100:00100000:2.0:1789062101.997479:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120377088 00000100:00100000:2.0:1789062101.997539:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:2.0:1789062101.997549:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+23:15612:x1875967120377088:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:2.0:1789062101.997857:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+24:15612:x1875967120377088:12345-192.168.203.3@tcp:35:cat.0 Request processed in 309us (484us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789062101.997864:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00010000:00010000:1.0:1789062102.058316:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789062102.092957:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.093101:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120377344 00000100:00100000:3.0:1789062102.093111:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120377344 00000100:00100000:3.0:1789062102.093184:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00080000:0.0:1789062102.093188:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789062102.093197:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+24:15618:x1875967120377344:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:3.0:1789062102.093231:0:19906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062102.093251:0:19906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fa0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd66 expref: -99 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.093411:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7fa7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.093425:0:19906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc7f45 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd43 expref: 25 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.093434:0:19906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd4a expref: 25 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.093442:0:19906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7fa7 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.093472:0:19906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd4a expref: 25 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.093485:0:19906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd4a expref: 25 pid: 17117 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062102.093497:0:19906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19906:1875967130937344:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789062102.093582:0:19906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc7f45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd43 expref: 25 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.093592:0:19906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc7f45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd43 expref: 25 pid: 17115 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062102.093959:0:19906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19906:1875967130937472:192.168.203.3@tcp:104: 00000100:00100000:3.0:1789062102.094006:0:19906:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c5d45d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789062102.099127:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062102.099208:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120377472 00000100:00100000:1.0:1789062102.099216:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120377472 00010000:00010000:1.0:1789062102.099253:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd4a expref: 26 pid: 17117 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062102.099319:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1789062102.099329:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+26:2393:x1875967120377472:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789062102.099343:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789062102.099350:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd4a expref: 26 pid: 17117 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.099361:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd4a expref: 26 pid: 17117 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.099381:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:1.0:1789062102.099386:0:17100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7fa7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.099395:0:17100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7fa7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.099401:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789062102.099445:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+26:2393:x1875967120377472:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 118us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062102.099452:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00010000:00010000:3.0:1789062102.102273:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7f5a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd4a expref: 25 pid: 17117 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062102.102310:0:19906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19906:1875967130937344:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789062102.103536:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062102.103803:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120377600 00000100:00100000:0.0:1789062102.103811:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120377600 00010000:00010000:0.0:1789062102.103847:0:17102:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc7f45 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd43 expref: 25 pid: 17115 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062102.103885:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:0.0:1789062102.103894:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c7771c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+25:2392:x1875967120377600:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789062102.103907:0:17102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789062102.103915:0:17102:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc7f45 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd43 expref: 25 pid: 17115 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.103927:0:17102:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc7f45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd43 expref: 25 pid: 17115 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.103948:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:0.0:1789062102.103954:0:17102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7fa7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.103964:0:17102:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.103972:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7fa7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.103989:0:17102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789062102.104084:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c7771c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+25:2392:x1875967120377600:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 190us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062102.104100:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00010000:00010000:3.0:1789062102.104329:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc7f45 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd43 expref: 24 pid: 17115 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062102.104346:0:19906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19906:1875967130937472:192.168.203.3@tcp:104: 00010000:00010000:3.0:1789062102.104367:0:19906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.104376:0:19906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.104382:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789062102.104399:0:19906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789062102.104535:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fa0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd66 expref: 25 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.104550:0:19906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cf600/0x2774d8f311dc7fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd66 expref: 24 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.104570:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:3.0:1789062102.104573:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789062102.104576:0:19906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cf600, rc 0) 00000100:00100000:3.0:1789062102.104929:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+24:15618:x1875967120377344:12345-192.168.203.3@tcp:101:dd.0 Request processed in 11734us (11980us total) trans 8589934609 rc 0/0 00000100:00100000:3.0:1789062102.104936:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:0.0:1789062102.108067:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.108254:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120377728 00000100:00100000:2.0:1789062102.108263:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120377728 00000100:00100000:2.0:1789062102.108356:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:2.0:1789062102.108379:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767df7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+24:15618:x1875967120377728:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1789062102.108402:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062102.108423:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7fb5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd6d expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.108453:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7fbc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.108467:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7fbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.108478:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7fbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.108589:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7fb5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd6d expref: 26 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.108653:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7fbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd6d expref: 25 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.108662:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062102.108664:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789062102.108668:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5771a00, rc 0) 00000100:00100000:2.0:1789062102.108726:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767df7d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+25:15618:x1875967120377728:12345-192.168.203.3@tcp:101:dd.0 Request processed in 340us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062102.108733:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:2.0:1789062102.111484:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062102.111583:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120377984 00000100:00100000:1.0:1789062102.111592:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120377984 00000100:00100000:1.0:1789062102.111993:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:1.0:1789062102.112004:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+25:15618:x1875967120377984:12345-192.168.203.3@tcp:36:dd.0 00010000:00010000:1.0:1789062102.112214:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7fc3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.112245:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.112254:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789062102.112299:0:17115:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:1.0:1789062102.112318:0:17115:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000465bc371 reply state 00000000509afc66 transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.112326:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7fc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.112331:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:1.0:1789062102.112333:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789062102.112335:0:17115:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789062102.112406:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+28:15618:x1875967120377984:12345-192.168.203.3@tcp:36:dd.0 Request processed in 405us (931us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1789062102.112412:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000020:00080000:1.0:1789062102.112417:0:17115:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789062102.115822:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.115868:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120378112 00000100:00100000:3.0:1789062102.115877:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120378112 00000100:00100000:2.0:1789062102.115972:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:2.0:1789062102.115984:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767df7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+28:15618:x1875967120378112:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1789062102.116024:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062102.116045:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7fca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd74 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.116105:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7fca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd74 expref: 29 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.116118:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7fca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd74 expref: 29 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.116136:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062102.116139:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789062102.116143:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5771400, rc 0) 00000100:00100000:2.0:1789062102.116202:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767df7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+29:15618:x1875967120378112:12345-192.168.203.3@tcp:101:dd.0 Request processed in 221us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062102.116209:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:0.0:1789062102.138926:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.139023:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120378368 00000100:00100000:2.0:1789062102.139036:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120378368 00000100:00100000:2.0:1789062102.139101:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:2.0:1789062102.139111:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767df7db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+29:15618:x1875967120378368:12345-192.168.203.3@tcp:103:dd.0 00010000:00010000:2.0:1789062102.139127:0:17101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789062102.139151:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7fca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd74 expref: 29 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.139170:0:17101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062102.139175:0:17101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789062102.139239:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767df7db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+28:15618:x1875967120378368:12345-192.168.203.3@tcp:103:dd.0 Request processed in 129us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062102.139261:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:1.0:1789062102.143271:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.143398:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120378496 00000100:00100000:3.0:1789062102.143406:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120378496 00000100:00100000:3.0:1789062102.143457:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:3.0:1789062102.143465:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+28:15618:x1875967120378496:12345-192.168.203.3@tcp:58:dd.0 00010000:00010000:3.0:1789062102.143566:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fd1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.143583:0:19906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.143594:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789062102.152029:0:19906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789062102.152061:0:19906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789062102.152229:0:19906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789062102.152659:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+28:15618:x1875967120378496:12345-192.168.203.3@tcp:58:dd.0 Request processed in 9189us (9391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062102.152670:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:1.0:1789062102.155530:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.155683:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120378624 00000100:00100000:3.0:1789062102.155693:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120378624 00000100:00100000:3.0:1789062102.155766:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:3.0:1789062102.155777:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+28:15618:x1875967120378624:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:3.0:1789062102.155799:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062102.155820:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7fd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd7b expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.155892:0:17117:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fd1 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.155903:0:17117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7fd8 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd7b expref: 29 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.155923:0:17117:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.155936:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7fd8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd7b expref: 29 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.155950:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:3.0:1789062102.155953:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789062102.155957:0:17117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7fd8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd7b expref: 29 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.155964:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c80cec00, rc 0) 00000100:00100000:3.0:1789062102.156026:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+29:15618:x1875967120378624:12345-192.168.203.3@tcp:101:dd.0 Request processed in 250us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.156033:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:0.0:1789062102.185912:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130937600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789062102.185984:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062102.186085:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130937600 00000100:00100000:3.0:1789062102.186101:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130937600 00000100:00100000:3.0:1789062102.186172:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789062102.186182:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767df7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130937600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789062102.186210:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789062102.186253:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767df7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875967130937600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.186272:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789062102.186335:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789062102.186371:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875967130937600:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1789062102.505803:0:17149:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789062102.505812:0:17149:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789062102.505856:0:17149:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789062102.505865:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789062102.506008:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b66a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17149:1875967130937728:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789062102.506101:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c8106e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789062102.512351:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b66a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17149:1875967130937728:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789062102.515028:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.515437:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120378752 00000100:00100000:3.0:1789062102.515447:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120378752 00000100:00100000:3.0:1789062102.515578:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:3.0:1789062102.515589:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+29:15619:x1875967120378752:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789062102.515894:0:17115:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789062102.516062:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+29:15619:x1875967120378752:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 474us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.516078:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:1.0:1789062102.522912:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.523010:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120378880 00000100:00100000:3.0:1789062102.523025:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120378880 00000100:00100000:3.0:1789062102.523139:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1789062102.523150:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+29:15619:x1875967120378880:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789062102.523223:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc7fdf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523239:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc7fdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523252:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc7fdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523312:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc7fe6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523321:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523328:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523364:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7fed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523373:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7fed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523381:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7fed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789062102.523423:0:17117:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789062102.523439:0:17117:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789062102.523455:0:17117:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7fed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523466:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc7fdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523473:0:17117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc7fdf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523480:0:17117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc7fdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523487:0:17117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789062102.523491:0:17117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc7fdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523499:0:17117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc7fdf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523510:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c15be500) 00010000:00010000:3.0:1789062102.523518:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789062102.523523:0:17117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc7fdf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523530:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc7fdf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523544:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523550:0:17117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc7fe6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523557:0:17117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc7fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523563:0:17117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807a600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789062102.523566:0:17117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc7fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523572:0:17117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc7fe6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523579:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9766c7417d00) 00010000:00010000:3.0:1789062102.523582:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789062102.523585:0:17117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc7fe6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523591:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc7fe6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523657:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7fed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523670:0:17117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7fed lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523676:0:17117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7fed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523681:0:17117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789062102.523684:0:17117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7fed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523690:0:17117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7fed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523699:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:3.0:1789062102.523701:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789062102.523704:0:17117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7fed lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.523710:0:17117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc7fed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062102.524037:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+29:15619:x1875967120378880:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 887us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.524046:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:0.0:1789062102.534393:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.534471:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120379136 00000100:00100000:2.0:1789062102.534490:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120379136 00000100:00100000:2.0:1789062102.534549:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:2.0:1789062102.534559:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767df7d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+29:15619:x1875967120379136:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789062102.534584:0:19906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062102.534603:0:19906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7ff4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd82 expref: -99 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.534746:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7ffb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.534761:0:19906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7ffb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.534803:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7ffb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789062102.534815:0:19906:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789062102.534960:0:19906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7ffb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.534966:0:19906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7ffb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.534970:0:19906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7ffb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.534974:0:19906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5771800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789062102.534976:0:19906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7ffb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.534981:0:19906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7ffb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.534989:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062102.534991:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789062102.534994:0:19906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7ffb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.534999:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc7ffb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.535039:0:19906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7ff4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd82 expref: 31 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.535062:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9766c15be500) 00010000:00010000:2.0:1789062102.535065:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789062102.535069:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc7ff4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd82 expref: 31 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.535078:0:19906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5771400, rc 0) 00000100:00100000:2.0:1789062102.536551:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767df7d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+30:15619:x1875967120379136:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1986us (2159us total) trans 8589934612 rc 301/301 00000100:00100000:2.0:1789062102.536562:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:1.0:1789062102.541169:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.541252:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120379264 00000100:00100000:2.0:1789062102.541260:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120379264 00000100:00100000:2.0:1789062102.541321:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:2.0:1789062102.541331:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+30:15619:x1875967120379264:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789062102.541363:0:17116:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789062102.541489:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+30:15619:x1875967120379264:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 158us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062102.541496:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:1.0:1789062102.550805:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.552600:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120379520 00000100:00100000:3.0:1789062102.552727:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120379520 00000100:00100000:3.0:1789062102.552992:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:3.0:1789062102.553004:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+30:15619:x1875967120379520:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789062102.553025:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062102.553058:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc8009 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd89 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789062102.553442:0:17115:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:3.0:1789062102.553448:0:17115:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:3.0:1789062102.553468:0:17115:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1789062102.553926:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc8010 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.553941:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc8010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.553951:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc8010 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.554010:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc8009 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd89 expref: 33 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.554028:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc8010 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd89 expref: 32 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.554036:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9766c7417d00) 00010000:00010000:3.0:1789062102.554039:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789062102.554042:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807a600, rc 0) 00000100:00100000:3.0:1789062102.554193:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+32:15619:x1875967120379520:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 1185us (3389us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789062102.554201:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:0.0:1789062102.559959:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.560047:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120379776 00000100:00100000:2.0:1789062102.560057:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120379776 00000100:00100000:2.0:1789062102.560117:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:2.0:1789062102.560127:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767df7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+32:15619:x1875967120379776:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789062102.560180:0:17116:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789062102.560212:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a600/0x2774d8f311dc8010 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd89 expref: 32 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560249:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9766c7417d00) 00010000:00010000:2.0:1789062102.560259:0:17116:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789062102.560282:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc801e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560295:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc801e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560305:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc801e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560319:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc8025 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xef8d6d06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560326:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc8025 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef8d6d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560333:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc8025 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef8d6d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560379:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc801e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560386:0:17116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc801e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560392:0:17116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc801e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560398:0:17116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5771400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789062102.560401:0:17116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc801e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560415:0:17116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc801e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560424:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9767d1235500) 00010000:00010000:2.0:1789062102.560426:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789062102.560431:0:17116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc801e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560437:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc801e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560447:0:17116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc8025 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef8d6d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560453:0:17116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc8025 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef8d6d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560460:0:17116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc8025 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef8d6d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560465:0:17116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5771800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789062102.560468:0:17116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc8025 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef8d6d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560475:0:17116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc8025 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef8d6d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560482:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xef8d6d06 (ffff9767d1235b00) 00010000:00010000:2.0:1789062102.560484:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789062102.560487:0:17116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc8025 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xef8d6d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.560504:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771800/0x2774d8f311dc8025 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xef8d6d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062102.560790:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767df7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+31:15619:x1875967120379776:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 663us (839us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789062102.560798:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:1.0:1789062102.566939:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.568296:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120379904 00000100:00100000:2.0:1789062102.568308:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120379904 00000100:00100000:2.0:1789062102.568377:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:2.0:1789062102.568388:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+31:15619:x1875967120379904:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789062102.568412:0:19906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062102.568436:0:19906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc802c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd90 expref: -99 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.568470:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc8033 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.568483:0:19906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc8033 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.568495:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc8033 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.568823:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771200/0x2774d8f311dc802c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd90 expref: 33 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.568844:0:19906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770600/0x2774d8f311dc8033 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd90 expref: 32 pid: 19906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.568865:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9767d1235000) 00010000:00010000:2.0:1789062102.568868:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789062102.568872:0:19906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5770600, rc 0) 00000100:00100000:2.0:1789062102.568969:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+32:15619:x1875967120379904:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 583us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062102.568976:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:1.0:1789062102.572123:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.572364:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120380160 00000100:00100000:3.0:1789062102.572373:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120380160 00000100:00100000:3.0:1789062102.572428:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:3.0:1789062102.572453:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+32:15619:x1875967120380160:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789062102.572534:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc803a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.572549:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc803a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.572560:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc803a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789062102.572845:0:17117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1789062102.572855:0:17117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 483682247948ns, next at 484682245536ns, rc = 0 00000004:00010000:3.0:1789062102.572900:0:17117:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004dc1d058 reply state 00000000aabf8c35 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc803a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.572913:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc803a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.572919:0:17117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9767d1235000) 00010000:00010000:3.0:1789062102.572922:0:17117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789062102.572926:0:17117:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789062102.573016:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+34:15619:x1875967120380160:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 564us (901us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1789062102.573023:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:0.0:1789062102.580784:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.580957:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120380288 00000100:00100000:3.0:1789062102.580967:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120380288 00000100:00100000:3.0:1789062102.581024:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:3.0:1789062102.581034:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767df7d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+34:15619:x1875967120380288:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789062102.581054:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062102.581104:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc8041 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd97 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.581157:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc8041 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd97 expref: 35 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.581170:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc8041 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd97 expref: 35 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.581196:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9767d1235000) 00010000:00010000:3.0:1789062102.581200:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789062102.581203:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807b200, rc 0) 00000100:00100000:3.0:1789062102.581261:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767df7d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+35:15619:x1875967120380288:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 228us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.581267:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1789062102.588174:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.588328:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120380416 00000100:00100000:2.0:1789062102.588337:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120380416 00000100:00100000:2.0:1789062102.588411:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1789062102.588422:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2393:x1875967120380416:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789062102.588691:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2393:x1875967120380416:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 271us (524us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789062102.588699:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00080000:0.0:1789062102.588772:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789062102.594945:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.595032:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120380672 00000100:00100000:2.0:1789062102.595042:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120380672 00000100:00100000:2.0:1789062102.595101:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:2.0:1789062102.595112:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+35:15619:x1875967120380672:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789062102.597745:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+36:15619:x1875967120380672:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 2623us (2797us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789062102.597759:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:1.0:1789062102.601819:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.601891:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120380928 00000100:00100000:2.0:1789062102.601900:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120380928 00000100:00100000:2.0:1789062102.601961:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:2.0:1789062102.601972:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+36:15619:x1875967120380928:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789062102.602462:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+36:15619:x1875967120380928:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 491us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062102.602471:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:2.0:1789062102.608272:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.608393:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120381056 00000100:00100000:3.0:1789062102.608403:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120381056 00000100:00100000:3.0:1789062102.608461:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:3.0:1789062102.608471:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+36:15619:x1875967120381056:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789062102.608491:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789062102.608511:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc8048 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bd9e expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.608577:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc804f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.608592:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc804f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.608662:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc804f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789062102.608705:0:17115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789062102.608798:0:17115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc804f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.608835:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807ae00/0x2774d8f311dc8048 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd9e expref: 38 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.608852:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc804f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd9e expref: 37 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.608860:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9767d1235000) 00010000:00010000:3.0:1789062102.608863:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789062102.608868:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c807a000, rc 0) 00000100:00100000:3.0:1789062102.608928:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+37:15619:x1875967120381056:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 459us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.608936:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:1.0:1789062102.612384:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.612570:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120381184 00000100:00100000:2.0:1789062102.612581:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120381184 00000100:00100000:2.0:1789062102.612664:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1789062102.612675:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+6:2392:x1875967120381184:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789062102.612692:0:18622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062102.612719:0:18622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007117f7ef/0x2774d8f311dc8056 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bda5 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789062102.612745:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2ebd5, blocks: 0x0 00010000:00010000:2.0:1789062102.612765:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=483s v=(0 0) 00010000:00010000:2.0:1789062102.612769:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062102.612778:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007117f7ef/0x2774d8f311dc8056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bda5 expref: 7 pid: 18622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.612794:0:18622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007117f7ef/0x2774d8f311dc8056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bda5 expref: 7 pid: 18622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.612808:0:18622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5771800, rc 0) 00000100:00100000:2.0:1789062102.612991:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+7:2392:x1875967120381184:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 318us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062102.612998:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:1.0:1789062102.616817:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.617177:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120381440 00000100:00100000:3.0:1789062102.617186:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120381440 00000100:00100000:3.0:1789062102.617274:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:3.0:1789062102.617285:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+37:15619:x1875967120381440:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789062102.617394:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+37:15619:x1875967120381440:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 111us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.617402:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:1.0:1789062102.620900:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.621001:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120381568 00000100:00100000:3.0:1789062102.621021:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120381568 00000100:00100000:3.0:1789062102.621209:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:3.0:1789062102.621219:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+37:15619:x1875967120381568:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789062102.628285:0:17095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000004:00080000:1.0:1789062102.628302:0:17095:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1789062102.628462:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628474:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628492:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628498:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5770800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789062102.628502:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628509:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628525:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9767d1235e00) 00010000:00010000:3.0:1789062102.628528:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789062102.628532:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e8f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628537:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc7e8f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628557:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628563:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e96 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628576:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628581:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5770c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789062102.628584:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628590:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e96 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628598:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9767d1235500) 00010000:00010000:3.0:1789062102.628600:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789062102.628641:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e96 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628647:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc7e96 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628660:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc7f3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628667:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc7f3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628672:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc7f3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628677:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5771600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789062102.628680:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc7f3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628696:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc7f3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628706:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9767d1235400) 00010000:00010000:3.0:1789062102.628708:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789062102.628720:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc7f3e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628727:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc7f3e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628741:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7fc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628748:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7fc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628755:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7fc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628760:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47a200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789062102.628763:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7fc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628769:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7fc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628777:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:3.0:1789062102.628779:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789062102.628782:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7fc3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628796:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47a200/0x2774d8f311dc7fc3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628808:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc803a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628814:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc803a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628820:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc803a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628836:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1789062102.628839:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc803a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628845:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc803a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628853:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9767d1235000) 00010000:00010000:3.0:1789062102.628856:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789062102.628858:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc803a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.628864:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b000/0x2774d8f311dc803a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062102.631043:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767df7da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130937856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789062102.631257:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1789062102.631451:0:17095:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1789062102.631516:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7ee3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.631527:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7ee3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.631533:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7ee3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.631538:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5771e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1789062102.631543:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7ee3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.631549:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7ee3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.631563:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9767d1235500) 00010000:00010000:1.0:1789062102.631567:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789062102.631571:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7ee3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.631578:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771e00/0x2774d8f311dc7ee3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062102.631901:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130937856 00000100:00100000:3.0:1789062102.631909:0:19396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130937856 00000100:00100000:3.0:1789062102.632004:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789062102.632013:0:19396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130937856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789062102.632143:0:19396:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789062102.632147:0:19396:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789062102.632150:0:19396:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789062102.632153:0:19396:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789062101 -> 1789062101 00002000:00010000:3.0:1789062102.632155:0:19396:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00080000:0.0:1789062102.632853:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789062102.633157:0:19396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3622:x1875967130937856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1142us (1897us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789062102.633166:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789062102.633421:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+15:15619:x1875967120381568:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 12202us (12527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.633430:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000004:00080000:2.0:1789062102.633550:0:3622:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9767df7da680/2, rc 0, transno 8589934596 00000100:00100000:2.0:1789062102.633557:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767df7da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130937856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789062102.637805:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.637951:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120381696 00000100:00100000:3.0:1789062102.637961:0:19096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120381696 00000100:00100000:3.0:1789062102.638017:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:3.0:1789062102.638026:0:19096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+7:2392:x1875967120381696:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789062102.638161:0:19096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+7:2392:x1875967120381696:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 135us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.638169:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1789062102.641569:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.641740:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120381952 00000100:00100000:2.0:1789062102.641748:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120381952 00000100:00100000:2.0:1789062102.641800:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:2.0:1789062102.641808:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+15:15619:x1875967120381952:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789062102.641862:0:17116:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789062102.641886:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807a000/0x2774d8f311dc804f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd9e expref: 15 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.641904:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9767d1235000) 00010000:00010000:2.0:1789062102.641909:0:17116:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789062102.641936:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc805d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.641949:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc805d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.641958:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc805d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789062102.642074:0:17116:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003057fd1d reply state 000000009146c1a0 transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc805d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.642085:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771400/0x2774d8f311dc805d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.642119:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9767d1235000) 00010000:00010000:2.0:1789062102.642121:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789062102.642124:0:17116:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789062102.642222:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+16:15619:x1875967120381952:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 414us (661us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789062102.642230:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:2.0:1789062102.646284:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062102.646422:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120382080 00000100:00100000:0.0:1789062102.646432:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120382080 00000100:00100000:0.0:1789062102.646496:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:0.0:1789062102.646506:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767c4b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+7:15619:x1875967120382080:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789062102.646523:0:18622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789062102.646542:0:18622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bdac expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.646572:0:18622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007117f7ef/0x2774d8f311dc8056 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bda5 expref: 8 pid: 18622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.646582:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789062102.646587:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789062102.646592:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdac expref: 8 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.646688:0:18622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007117f7ef/0x2774d8f311dc8056 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bda5 expref: 8 pid: 18622 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.646702:0:18622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007117f7ef/0x2774d8f311dc8056 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bda5 expref: 8 pid: 18622 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062102.646728:0:18622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767df7dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18622:1875967130937984:192.168.203.3@tcp:104: 00000100:00100000:0.0:1789062102.646804:0:18622:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767d1fa03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789062102.652428:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.652572:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120382208 00000100:00100000:2.0:1789062102.652581:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120382208 00010000:00010000:2.0:1789062102.652659:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007117f7ef/0x2774d8f311dc8056 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bda5 expref: 9 pid: 18622 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062102.652697:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:2.0:1789062102.652707:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+9:2393:x1875967120382208:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789062102.652732:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789062102.652753:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007117f7ef/0x2774d8f311dc8056 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bda5 expref: 9 pid: 18622 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.652767:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007117f7ef/0x2774d8f311dc8056 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bda5 expref: 9 pid: 18622 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.652791:0:17100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062102.652795:0:17100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062102.652802:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdac expref: 9 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.652842:0:17100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdac expref: 9 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.652879:0:17100:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdac expref: 9 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062102.652892:0:17100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767c4b67100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17100:1875967130938112:192.168.203.3@tcp:105: 00000100:00100000:2.0:1789062102.652960:0:17100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c8106240 going to sleep for 11 seconds 00010000:00010000:0.0:1789062102.653112:0:18622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007117f7ef/0x2774d8f311dc8056 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bda5 expref: 9 pid: 18622 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062102.653128:0:18622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767df7dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18622:1875967130937984:192.168.203.3@tcp:104: 00010000:00010000:0.0:1789062102.653150:0:18622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdac expref: 8 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.653160:0:18622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9767c0031800, rc 0) 00000100:00100000:0.0:1789062102.653189:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767c4b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+8:15619:x1875967120382080:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 6684us (6914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062102.653196:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:2.0:1789062102.658313:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062102.658384:0:19396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120382336 00000100:00100000:0.0:1789062102.658394:0:19396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120382336 00000100:00100000:0.0:1789062102.658449:0:19396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:0.0:1789062102.658459:0:19396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1b10d670-7f0f-4a11-9d02-f894398913c8+8:2392:x1875967120382336:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789062102.658643:0:19396:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789062102.658647:0:19396:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789062100 00002000:00010000:0.0:1789062102.658649:0:19396:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789062099 00002000:00010000:0.0:1789062102.658651:0:19396:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789062101 -> 1789062100 00002000:00010000:0.0:1789062102.658653:0:19396:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789062102.658700:0:19396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1b10d670-7f0f-4a11-9d02-f894398913c8+9:2392:x1875967120382336:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 243us (399us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789062102.658708:0:19396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:3.0:1789062102.658853:0:17100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767c4b67100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17100:1875967130938112:192.168.203.3@tcp:105: 00010000:00010000:3.0:1789062102.658875:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062102.658899:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+8:2393:x1875967120382208:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 6195us (6481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.658909:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1789062102.663565:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.663689:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120382464 00000100:00100000:2.0:1789062102.663699:0:18619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120382464 00000100:00100000:2.0:1789062102.663766:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:2.0:1789062102.663777:0:18619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+8:2391:x1875967120382464:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789062102.663817:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.663848:0:18619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdac expref: 8 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.663857:0:18619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789062102.663862:0:18619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789062102.663866:0:18619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.663921:0:18619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdac expref: 8 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.663936:0:18619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdac expref: 8 pid: 18622 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062102.663949:0:18619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18619:1875967130938240:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789062102.664029:0:18619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c8106240 going to sleep for 11 seconds 00000100:00100000:1.0:1789062102.671080:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062102.671272:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120382592 00000100:00100000:0.0:1789062102.671281:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120382592 00010000:00010000:0.0:1789062102.671326:0:17102:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdac expref: 9 pid: 18622 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789062102.671362:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:0.0:1789062102.671371:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+9:2393:x1875967120382592:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789062102.671386:0:17102:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789062102.671408:0:17102:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdac expref: 9 pid: 18622 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.671422:0:17102:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdac expref: 9 pid: 18622 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.671445:0:17102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789062102.671449:0:17102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789062102.671455:0:17102:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.671491:0:17102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.671511:0:17102:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789062102.671558:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+9:2393:x1875967120382592:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 188us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062102.671565:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00010000:00010000:2.0:1789062102.672458:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012c88de1/0x2774d8f311dc8064 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdac expref: 8 pid: 18622 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062102.672487:0:18619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18619:1875967130938240:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789062102.672507:0:18619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.672518:0:18619:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.672525:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.672548:0:18619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.672571:0:18619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.672580:0:18619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.672587:0:18619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5771600 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062102.672591:0:18619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.672601:0:18619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.672669:0:18619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.672676:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5819e0c/0x2774d8f311dc806b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062102.672748:0:18619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+7:2391:x1875967120382464:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 8974us (9192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062102.672757:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:1.0:1789062102.674846:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.674964:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120382848 00000100:00100000:2.0:1789062102.674973:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120382848 00000100:00100000:2.0:1789062102.675030:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:2.0:1789062102.675049:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+16:15619:x1875967120382848:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789062102.675124:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.675139:0:19906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7fbc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd6d expref: 16 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.675157:0:19906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.675189:0:19906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7fbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd6d expref: 16 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.675204:0:19906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7fbc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd6d expref: 16 pid: 17116 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062102.675216:0:19906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19906:1875967130938368:192.168.203.3@tcp:104: 00000100:00100000:2.0:1789062102.675292:0:19906:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c8106c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789062102.677923:0:19906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19906:1875967130938368:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789062102.677948:0:19906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062102.678594:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.682560:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120382976 00000100:00100000:3.0:1789062102.682573:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120382976 00010000:00010000:2.0:1789062102.683367:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7fbc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd6d expref: 17 pid: 17116 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062102.683406:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1789062102.683416:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+17:2392:x1875967120382976:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789062102.683461:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789062102.683469:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7fbc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd6d expref: 17 pid: 17116 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.683958:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7fbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd6d expref: 17 pid: 17116 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.683981:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc7fbc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd6d expref: 17 pid: 17116 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.683998:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062102.684003:0:17100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7fd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd7b expref: 16 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.684012:0:17100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.684019:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.684027:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.684056:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789062102.684182:0:19906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.684191:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.684378:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.684391:0:19906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc8041 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd97 expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.684400:0:19906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.684427:0:19906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc8041 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd97 expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062102.684440:0:19906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc8041 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd97 expref: 17 pid: 17115 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062102.684453:0:19906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6729f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19906:1875967130938496:192.168.203.3@tcp:104: 00000100:00100000:1.0:1789062102.684546:0:19906:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767fb0e6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789062102.685111:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+17:2392:x1875967120382976:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1693us (6515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062102.685122:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1789062102.690088:0:19906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6729f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19906:1875967130938496:192.168.203.3@tcp:104: 00010000:00010000:2.0:1789062102.690130:0:19906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062102.691363:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.691472:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120383104 00000100:00100000:3.0:1789062102.691501:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120383104 00010000:00010000:3.0:1789062102.691539:0:17101:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc8041 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd97 expref: 17 pid: 17115 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789062102.691581:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:3.0:1789062102.691590:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+17:2393:x1875967120383104:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789062102.691623:0:17101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789062102.691631:0:17101:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc8041 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd97 expref: 17 pid: 17115 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.691644:0:17101:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc8041 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd97 expref: 17 pid: 17115 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.691664:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c807b200/0x2774d8f311dc8041 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd97 expref: 17 pid: 17115 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.691680:0:17101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9767d1235000) 00010000:00010000:3.0:1789062102.691685:0:17101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.691695:0:17101:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.691702:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.691733:0:17101:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789062102.691780:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+16:2393:x1875967120383104:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 190us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.691796:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00010000:00010000:2.0:1789062102.691970:0:19906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.691979:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789062102.692120:0:19906:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789062102.692230:0:19906:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:2.0:1789062102.692268:0:19906:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789062102.692403:0:19906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19906:1875967130938624:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789062102.692449:0:19906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062102.696719:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130938624 00000100:00100000:3.0:1789062102.696736:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130938624 00000100:00100000:3.0:1789062102.696805:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789062102.696815:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19906:x1875967130938624:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789062102.697179:0:19906:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767ce1db600 going to sleep for 11 seconds 00000100:00100000:3.0:1789062102.697329:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19906:x1875967130938624:12345-0@lo:1000:mdt00_003.0 Request processed in 515us (4880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.697338:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789062102.697415:0:19906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19906:1875967130938624:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789062102.698043:0:19906:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:2.0:1789062102.698114:0:19906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19906:1875967130938752:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789062102.698156:0:19906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062102.698348:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c77a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130938880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789062102.698808:0:19906:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789062102.698957:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789062102.698967:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767df7dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130939008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789062102.698999:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062102.703020:0:18432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130938752 00000100:00100000:1.0:1789062102.703035:0:18432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130938752 00000100:00100000:1.0:1789062102.703091:0:18432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130939008 00000100:00100000:1.0:1789062102.703095:0:18432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130939008 00000100:00100000:1.0:1789062102.703114:0:18432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789062102.703123:0:18432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c81aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:19906:x1875967130938752:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789062102.703266:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062102.703329:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130938880 00000100:00100000:3.0:1789062102.703333:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130938880 00000100:00100000:3.0:1789062102.703354:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789062102.703360:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767df7d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130939008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789062102.703384:0:17121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789062102.703460:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767df7d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875967130939008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (4459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.703467:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789062102.703494:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789062102.703501:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130938880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789062102.703516:0:17121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789062102.703543:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767df7dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875967130939008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789062102.703553:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130938880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062102.703559:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789062102.703648:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c77a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130938880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789062102.704036:0:18432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c81aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:19906:x1875967130938752:12345-0@lo:1000:mdt00_003.0 Request processed in 914us (5879us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789062102.704044:0:18432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789062102.704101:0:19906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c81ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19906:1875967130938752:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789062102.704144:0:19906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704154:0:19906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704175:0:19906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704181:0:19906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767fd47b600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789062102.704241:0:19906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704251:0:19906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704266:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9767d1235000) 00010000:00010000:2.0:1789062102.704269:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789062102.704274:0:19906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704280:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767fd47b600/0x2774d8f311dc8079 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704312:0:19906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704319:0:19906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fd1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704325:0:19906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fd1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704329:0:19906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c80ce200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789062102.704332:0:19906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fd1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704348:0:19906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fd1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704357:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062102.704360:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789062102.704534:0:19906:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7fd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd7b expref: 19 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704548:0:19906:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7fd8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd7b expref: 19 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.704559:0:19906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd7b expref: 19 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.705027:0:19906:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80cec00/0x2774d8f311dc7fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bd7b expref: 19 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062102.705043:0:19906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19906:1875967130939136:192.168.203.3@tcp:105: 00000100:00100000:2.0:1789062102.705167:0:19906:0:(client.c:2716:ptlrpc_set_wait()) set ffff9767c9ab0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789062102.710633:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.710770:0:19906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19906:1875967130939136:192.168.203.3@tcp:105: 00010000:00010000:2.0:1789062102.710803:0:19906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fd1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062102.710812:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120383232 00010000:00010000:2.0:1789062102.710813:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c80ce200/0x2774d8f311dc7fd1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062102.710819:0:17118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120383232 00010000:00010000:2.0:1789062102.710844:0:19906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc8080 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710870:0:19906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc8080 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710881:0:19906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc8080 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710893:0:19906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc8080 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710899:0:19906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc8080 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710906:0:19906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc8080 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710911:0:19906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5771a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789062102.710916:0:19906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc8080 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710922:0:19906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc8080 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062102.710927:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00010000:00010000:2.0:1789062102.710933:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062102.710936:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789062102.710936:0:17118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767f7e60050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+20:15618:x1875967120383232:12345-192.168.203.3@tcp:49:dd.0 00010000:00010000:2.0:1789062102.710940:0:19906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc8080 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710945:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771a00/0x2774d8f311dc8080 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710953:0:19906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710965:0:19906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710969:0:19906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710974:0:19906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c5770c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1789062102.710977:0:19906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710982:0:19906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710990:0:19906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062102.710992:0:19906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789062102.710995:0:19906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.710999:0:19906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770c00/0x2774d8f311dc8072 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19906 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789062102.711181:0:17149:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789062102.711186:0:17149:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789062102.711201:0:17149:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789062102.711205:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789062102.711280:0:17118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767f7e60050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+20:15618:x1875967120383232:12345-192.168.203.3@tcp:49:dd.0 Request processed in 344us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062102.711289:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:2.0:1789062102.711593:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+19:15619:x1875967120382848:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 36545us (36753us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1789062102.711722:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000020:00080000:2.0:1789062102.711726:0:19906:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789062102.715889:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062102.715954:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120383360 00000100:00100000:2.0:1789062102.715973:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120383360 00000100:00100000:2.0:1789062102.716023:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1789062102.716032:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+19:15618:x1875967120383360:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1789062102.716050:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789062102.716067:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc8087 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa68ad2aa9a3bdb3 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.716100:0:17116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc808e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.716115:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc808e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.716126:0:17116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc808e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17116 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.716231:0:17116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5771600/0x2774d8f311dc8087 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdb3 expref: 21 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.716250:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766c5770800/0x2774d8f311dc808e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xfa68ad2aa9a3bdb3 expref: 20 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.716258:0:17116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9767d1235100) 00010000:00010000:2.0:1789062102.716261:0:17116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789062102.716264:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766c5770800, rc 0) 00000100:00100000:2.0:1789062102.716334:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+20:15618:x1875967120383360:12345-192.168.203.3@tcp:101:dd.0 Request processed in 303us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062102.716341:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:2.0:1789062102.727267:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062102.727402:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120383616 00000100:00100000:0.0:1789062102.727412:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120383616 00000100:00100000:0.0:1789062102.727471:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1789062102.727489:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+20:15619:x1875967120383616:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789062102.727784:0:17119:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789062102.727815:0:17119:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:0.0:1789062102.727847:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc8095 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.727863:0:17119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc8095 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.727874:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc8095 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.727893:0:17119:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc8095 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.727900:0:17119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc8095 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.727907:0:17119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc8095 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.727924:0:17119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789062102.728018:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+22:15619:x1875967120383616:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 530us (759us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1789062102.728026:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000020:00080000:0.0:1789062102.728031:0:17119:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789062102.728108:0:17104:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789062102.728115:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc8095 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.728122:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031800 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062102.728126:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc8095 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.728134:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc8095 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.728148:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9767d1235000) 00010000:00010000:2.0:1789062102.728151:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789062102.728155:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc8095 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.728160:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9767c0031800/0x2774d8f311dc8095 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062102.728172:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062102.728173:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789062102.728175:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789062102.967195:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062102.967328:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120383744 00000100:00100000:3.0:1789062102.967338:0:18625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120383744 00000100:00100000:3.0:1789062102.967425:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1789062102.967436:0:18625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767df7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+7:2393:x1875967120383744:12345-192.168.203.3@tcp:4:dd.0 00002000:00010000:3.0:1789062102.967494:0:18625:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa2ebd4, atime: 0x6aa2ebd3, ctime: 0x6aa2ebd4, blocks: 0x0 00010000:00010000:3.0:1789062102.967503:0:18625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc725225/0x2774d8f311dc809c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.967518:0:18625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789062102.967522:0:18625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789062102.967528:0:18625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc725225/0x2774d8f311dc809c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789062102.967543:0:18625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc725225/0x2774d8f311dc809c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062102.975689:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1789062102.975806:0:18627:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789062102.975816:0:18627:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789062102.976112:0:18627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120383872 00000100:00100000:1.0:1789062102.976121:0:18627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120383872 00000100:00100000:0.0:1789062102.988323:0:20256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:0.0:1789062102.988347:0:20256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c75d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+8:2393:x1875967120383872:12345-192.168.203.3@tcp:4:dd.0 00010000:00010000:0.0:1789062102.988388:0:20256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d90cdac4/0x2774d8f311dc80a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.988404:0:20256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789062102.988408:0:20256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789062102.988414:0:20256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d90cdac4/0x2774d8f311dc80a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789062102.988427:0:20256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d90cdac4/0x2774d8f311dc80a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062103.082526:0:20142:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789062103.150679:0:19436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1789062103.150704:0:19436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1789062103.161857:0:18625:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789062103.161869:0:18625:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789062100 -> 1789062101 00002000:00010000:2.0:1789062103.161872:0:18625:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789062100 -> 1789062101 00002000:00010000:2.0:1789062103.161874:0:18625:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1789062103.161897:0:18625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc725225/0x2774d8f311dc809c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062103.161941:0:18625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc725225/0x2774d8f311dc809c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062103.161952:0:18625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc725225/0x2774d8f311dc809c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062103.161961:0:18625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766c807b200 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:2.0:1789062103.161968:0:18625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc725225/0x2774d8f311dc809c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062103.161979:0:18625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc725225/0x2774d8f311dc809c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062103.162004:0:18625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc725225/0x2774d8f311dc809c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789062103.162012:0:18625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc725225/0x2774d8f311dc809c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789062103.162157:0:18625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767df7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1b10d670-7f0f-4a11-9d02-f894398913c8+7:2393:x1875967120383744:12345-192.168.203.3@tcp:4:dd.0 Request processed in 194715us (194973us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789062103.162175:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000001:00080000:2.0:1789062103.177263:0:19436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1789062103.180274:0:20256:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1789062103.180291:0:20256:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1789062103.180320:0:20256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d90cdac4/0x2774d8f311dc80a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062103.180340:0:20256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d90cdac4/0x2774d8f311dc80a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062103.180382:0:20256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d90cdac4/0x2774d8f311dc80a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062103.180390:0:20256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9767c0031c00 already unused, calling callback (ffffffffc0eed8b0) 00010000:00010000:1.0:1789062103.180396:0:20256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d90cdac4/0x2774d8f311dc80a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062103.180408:0:20256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d90cdac4/0x2774d8f311dc80a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062103.180436:0:20256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d90cdac4/0x2774d8f311dc80a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789062103.180444:0:20256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d90cdac4/0x2774d8f311dc80a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789062103.180688:0:20256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c75d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2393:x1875967120383872:12345-192.168.203.3@tcp:4:dd.0 Request processed in 192334us (204989us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789062103.180718:0:20256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:1.0:1789062103.215541:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789062103.215576:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767df7d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130939264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789062103.215733:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062103.216000:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130939264 00000100:00100000:0.0:1789062103.216011:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130939264 00000100:00100000:0.0:1789062103.216114:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789062103.216126:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c672a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130939264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789062103.216156:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789062103.216216:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c672a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130939264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062103.216224:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789062103.217185:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789062103.217247:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767df7d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130939264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789062104.108315:0:20141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062104.235785:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130939392:0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.235809:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130939648:0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.235961:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062104.236015:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130940160:0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.236039:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062104.236060:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130940672:0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.236086:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062104.236115:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789062104.236121:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875967130940544:0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.236145:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062104.236165:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130941056:0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.236220:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130939776:0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.236258:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062104.236294:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130940288:0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.236318:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062104.236335:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130940800:0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.236356:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062104.236373:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789062104.236379:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130939904:0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.236399:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062104.236416:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130940416:0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.236428:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062104.236436:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789062104.236451:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c6728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130940928:0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.236473:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130939648 00000100:00100000:2.0:1789062104.236477:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789062104.236482:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130939648 00000100:00100000:2.0:1789062104.236499:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130939776 00000100:00100000:2.0:1789062104.236502:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130939776 00000100:00100000:2.0:1789062104.236531:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130940288 00000100:00100000:1.0:1789062104.236531:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130940160 00000100:00100000:2.0:1789062104.236534:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130940288 00000100:00100000:1.0:1789062104.236534:0:17120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130940160 00000100:00100000:1.0:1789062104.236552:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789062104.236555:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130939904 00000100:00100000:2.0:1789062104.236556:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130939904 00000100:00100000:1.0:1789062104.236560:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130939648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.236568:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130940416 00000100:00100000:2.0:1789062104.236570:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130940416 00000100:00100000:2.0:1789062104.236583:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789062104.236589:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c83e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130939776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.236652:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c83e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130939776:12345-0@lo:400:kworker.0 Request processed in 61us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062104.236660:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789062104.236679:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789062104.236685:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130940288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.236722:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130940288:12345-0@lo:400:kworker.0 Request processed in 37us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062104.236736:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789062104.236748:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789062104.236754:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130939904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.236790:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875967130939904:12345-0@lo:400:kworker.0 Request processed in 37us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062104.236793:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875967130939648:12345-0@lo:400:kworker.0 Request processed in 233us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062104.236797:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789062104.236799:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789062104.236808:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789062104.236811:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789062104.236813:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130940416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.236816:0:17120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c6729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130940160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.236839:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875967130940416:12345-0@lo:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062104.236839:0:17120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c6729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130940160:12345-0@lo:400:kworker.0 Request processed in 22us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062104.236846:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789062104.236846:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789062104.236871:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789062104.236875:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789062104.236892:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1789062104.236899:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9767df7da680, transno 8589934596 00000100:00100000:1.0:1789062104.236899:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875967130939648:0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.236908:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130940160:0@lo:400:kworker.0 00000004:00080000:2.0:1789062104.236910:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1789062104.236927:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130939904:0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.236937:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130940416:0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.236937:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130940672 00000100:00100000:1.0:1789062104.236941:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130940672 00000100:00100000:2.0:1789062104.236946:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875967130939776:0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.236954:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875967130940288:0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.236967:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130940544 00000100:00100000:1.0:1789062104.236970:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130940544 00000100:00100000:1.0:1789062104.236981:0:19906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130940800 00000100:00100000:1.0:1789062104.236983:0:19906:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130940800 00000100:00100000:2.0:1789062104.237112:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130941056 00000100:00100000:2.0:1789062104.237116:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130941056 00000100:00100000:2.0:1789062104.237137:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130940928 00000100:00100000:2.0:1789062104.237139:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130940928 00000100:00100000:2.0:1789062104.237153:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789062104.237159:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130940672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.237210:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875967130940672:12345-0@lo:400:kworker.0 Request processed in 50us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062104.237250:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789062104.237259:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875967130940544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.237294:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875967130940544:12345-0@lo:400:kworker.0 Request processed in 36us (1148us total) trans 0 rc 0/0 00000100:00080000:0.0:1789062104.237738:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789062104.237743:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789062104.237837:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875967130940544:0@lo:400:kworker.0 00000100:00100000:0.0:1789062104.237850:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875967130940672:0@lo:400:kworker.0 00000100:00100000:0.0:1789062104.237937:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9767df7d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130941184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789062104.237989:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789062104.238035:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130941184 00000100:00100000:0.0:1789062104.238040:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130941184 00000100:00100000:0.0:1789062104.238078:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789062104.238086:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767df7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130941184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789062104.238103:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:0.0:1789062104.238141:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767df7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875967130941184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062104.238148:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789062104.239755:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9767df7d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875967130941184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789062104.240433:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062104.240519:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c75d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130939520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789062104.240580:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062104.240603:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9766c672aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130940032:0@lo:400:kworker.0 00000100:00100000:3.0:1789062104.240646:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789062104.240938:0:17115:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789062104.240950:0:17115:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789062104.240972:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789062104.240979:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130940032 00000100:00100000:3.0:1789062104.240986:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130940032 00000100:00100000:2.0:1789062104.241197:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789062104.241232:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789062104.241245:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130940800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.241248:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789062104.241273:0:19906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789062104.241281:0:19906:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd5c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130941056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.241316:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875967130940800:12345-0@lo:400:kworker.0 Request processed in 75us (4958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062104.241319:0:19906:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd5c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875967130941056:12345-0@lo:400:kworker.0 Request processed in 40us (4890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062104.241323:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789062104.241325:0:19906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789062104.241335:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789062104.241347:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c8170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130940928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.241358:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130939392 00000100:00100000:1.0:1789062104.241362:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130939392 00000100:00100000:2.0:1789062104.241378:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c8170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875967130940928:12345-0@lo:400:kworker.0 Request processed in 37us (4900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062104.241384:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789062104.241392:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789062104.241398:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+24:3622:x1875967130939392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789062104.241423:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875967130940928:0@lo:400:kworker.0 00010000:00080000:2.0:1789062104.241440:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c6728a80 x1875967130940800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789062104.241452:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875967130940800:0@lo:400:kworker.0 00000100:00100000:1.0:1789062104.241507:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd818050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:83f5b9c6-643c-4659-afe5-bacf144ade05+24:3622:x1875967130939392:12345-0@lo:400:kworker.0 Request processed in 108us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062104.241514:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789062104.241543:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c6729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:83f5b9c6-643c-4659-afe5-bacf144ade05:3622:1875967130939392:0@lo:400:kworker.0 00010000:00080000:1.0:1789062104.241555:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9766c672b800 x1875967130941056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789062120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789062104.241770:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875967130941056:0@lo:400:kworker.0 00000100:00100000:0.0:1789062104.242317:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967130939520 00000100:00100000:0.0:1789062104.242326:0:18623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967130939520 00000100:00100000:0.0:1789062104.242366:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789062104.242374:0:18623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130939520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789062104.242394:0:18623:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:0.0:1789062104.242455:0:18623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875967130939520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062104.242462:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789062104.242511:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c75d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875967130939520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789062104.249862:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789062104.249905:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130940032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789062104.250031:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875967130940032:12345-0@lo:400:kworker.0 Request processed in 138us (9383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789062104.250039:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789062104.250568:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9766c672aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875967130940032:0@lo:400:kworker.0 00000040:00080000:0.0:1789062104.746686:0:17149:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789062104.746706:0:17149:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789062104.746729:0:17149:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789062104.746736:0:17149:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:0.0:1789062104.918567:0:20295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789062105.130826:0:17103:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789062105.352572:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062105.353434:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062105.353579:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120384000 00000100:00100000:1.0:1789062105.353593:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120384000 00000100:00100000:1.0:1789062105.353716:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 167 00000100:00100000:1.0:1789062105.353728:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9767fd81a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:2391:x1875967120384000:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789062105.353823:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9767fd81a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8094d664-afc8-4820-b5e6-f6352ebb9a04+13:2391:x1875967120384000:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 97us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062105.353831:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 167 00000100:00100000:3.0:1789062105.355794:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062105.355999:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062105.356167:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1789062105.356258:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120384128 00000100:00100000:2.0:1789062105.356269:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120384128 00000100:00100000:2.0:1789062105.356344:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120384640 00000100:00100000:2.0:1789062105.356348:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120384640 00000100:00100000:2.0:1789062105.356376:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:2.0:1789062105.356387:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+22:2391:x1875967120384128:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789062105.356501:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1b10d670-7f0f-4a11-9d02-f894398913c8+22:2391:x1875967120384128:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 116us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062105.356510:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:2.0:1789062105.356530:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00100000:2.0:1789062105.356536:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:2390:x1875967120384640:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1789062105.356565:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+6:2390:x1875967120384640:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 29us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789062105.356571:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 71 00000100:00080000:2.0:1789062105.356637:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789062105.358309:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062105.358336:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062105.358409:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120384256 00000100:00100000:1.0:1789062105.358420:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120384256 00000100:00100000:1.0:1789062105.358488:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00100000:1.0:1789062105.358498:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2390:x1875967120384256:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789062105.358574:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2390:x1875967120384256:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062105.358582:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 72 00000100:00080000:1.0:1789062105.358621:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789062105.359626:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120384384 00000100:00100000:0.0:1789062105.359637:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120384384 00000100:00100000:0.0:1789062105.359725:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120384896 00000100:00100000:0.0:1789062105.359732:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120384896 00000100:00100000:0.0:1789062105.359761:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:0.0:1789062105.359770:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2390:x1875967120384384:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789062105.360528:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2390:x1875967120384384:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 752us (4739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062105.360539:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:0.0:1789062105.360596:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:0.0:1789062105.360637:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2390:x1875967120384896:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789062105.360701:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2390:x1875967120384896:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 90us (4526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062105.360708:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00080000:1.0:1789062105.361685:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789062105.367402:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1789062105.367469:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1789062105.367715:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120384512 00000100:00100000:1.0:1789062105.367729:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120384512 00000100:00100000:1.0:1789062105.367815:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120385024 00000100:00100000:1.0:1789062105.367819:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120385024 00000100:00100000:1.0:1789062105.367856:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:1.0:1789062105.367868:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2390:x1875967120384512:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789062105.367970:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1b10d670-7f0f-4a11-9d02-f894398913c8+5:2390:x1875967120384512:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 103us (9631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062105.367994:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:1.0:1789062105.368014:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:1.0:1789062105.368020:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2390:x1875967120385024:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1789062105.368046:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2390:x1875967120385024:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789062105.368052:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00080000:3.0:1789062105.371575:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789062105.371834:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875967120384768 00000100:00100000:0.0:1789062105.371859:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875967120384768 00000100:00100000:0.0:1789062105.371951:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00100000:0.0:1789062105.371961:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9766c77a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2390:x1875967120384768:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1789062105.372244:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9766c77a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfa2bb37-f57c-4eb1-aa57-40b8fc9714c4+5:2390:x1875967120384768:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 108us (4681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789062105.372254:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 73 00000100:00080000:3.0:1789062105.372753:0:17111:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789062106.154016:0:17104:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42031 lines, 42031 kept, 0 dropped, 0 bad.